About the Opportunity
Epsilon is a leading provider of multi-channel marketing services, technologies and database solutions. A subsidiary of Publicis Groupe, Epsilon is seeking a Lead Big Data Administrator – Databricks with a balance of skills in design, physical implementation, and performance tuning to work out of our Bengaluru, India location supporting Databricks and Big Data solutions running on premise and on Public Cloud infrastructure for Database Marketing clients.
Duties and Responsibilities:
3 plus years’ experience with Databricks Lakehouse Platform
Experience as the Databricks account owner, managing workspaces, AWS accounts, audit logs, and high-level usage monitoring.
Experience as Databricks workspace admin, managing workspace users and groups including single sign-on, provisioning, access control, and workspace storage.
Demonstrated ability to troubleshoot end-user and platform-level issues.
Familiarity with configuring cluster and job settings in Databricks.
Monitor and manage platform costs, including optimizing resource utilization to control expenses.
Implement and enforce security policies, access controls, and encryption mechanisms.
Strong understanding of S3 access management across a diverse user base.
Monitor and manage auto-scaling to ensure resources are allocated efficiently.
Stay up to date with security best practices and compliance requirements.
Maintain detailed documentation of configurations, procedures, and best practices.
Interact with vendor support to ensure open issues are resolved within defined SLA.
Conduct training sessions to educate users on platform best practices and capabilities.
Collaborate with cross-functional teams, including data scientists, data engineers, and business analysts, to understand their requirements and provide technical solutions.
Collaborate with data engineers to integrate Databricks with other data sources, data warehouses, and data lakes.
Provide 24 x 7 x 365 support through on-call rotation.
Qualifications
8+ years of general technology experience (preferably database administration)
3 years’ experience with Databricks Lakehouse Platform (AWS preferred)
Strong knowledge of Python, Apache Spark and Databricks architecture.
Proficiency in cloud platforms like AWS, Azure, or Google Cloud.
Experience with Linux/Unix system administration.
Strong Unix/Linux and shell scripting
Competence to read and write SQL code.
Ability to diagnose problems and resolve issues across various tiers
Adherence to SDLC, Change Management, troubleshooting and development methodologies.
Ability to perform work with minimal supervisory direction
Excellent written and verbal communication skills
Superb analytical and problem-solving skills
Education/Certification
B.S. in Computer Science or related discipline or equivalent work experience required. Databricks Platform Administration and/or AWS certification is a plus.
…