Lead Data Engineer Job at Openkyber, Atlanta, GA

  • Openkyber
  • Atlanta, GA

Job Description

job summary: We are seeking an experienced Databricks Data Engineer to join our high-performing Data & AI practice in Phoenix, AZ. In this role, you will be responsible for designing and deploying enterprise-grade Lakehouse solutions on Google Cloud Platform (Google Cloud Platform). You will build robust batch and real-time data pipelines, optimize ETL/ELT processes, and implement data governance using Unity Catalog to power advanced analytics across the enterprise.

location: Phoenix, Arizona

job type: Contract

salary: $40 - 50 per hour

work hours: 8am to 5pm

education: Bachelors

responsibilities: Design, build, and maintain scalable batch and real-time data engineering pipelines using Databricks, PySpark, and SQL. Integrate Databricks seamlessly with Google Cloud Platform services including Google Cloud Storage (GCS), BigQuery, Pub/Sub, and Cloud Composer. Implement metadata-driven ingestion frameworks, incremental load patterns, and structured data models. Configure and manage Databricks Unity Catalog to enforce fine-grained access controls, security, and data lineage. Implement automated orchestrations using Cloud Composer/Apache Airflow and drive CI/CD DataOps best practices.

qualifications: 4+ years of hands-on data engineering experience building enterprise data pipelines with Databricks and PySpark. Strong experience with Google Cloud Platform cloud architecture and native services (GCS, BigQuery, Pub/Sub, Cloud Composer). Proven capability in data modeling, complex SQL development, and pipeline performance optimization. Practical experience configuring Databricks Unity Catalog, Delta Live Tables, and Auto Loader. Solid understanding of CI/CD deployment and DevOps workflows in cloud data environments.

PREFERRED QUALIFICATIONS Proficiency in Scala for Spark processing. Formal Google Cloud Platform or Databricks certifications (e.g., Databricks Certified Data Engineer Professional, Google Cloud Platform Professional Data Engineer). Experience with automated testing and DataOps frameworks.

Equal Opportunity Employer: Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status. At OpenKyber, we welcome people of all abilities and want to ensure that our hiring and interview process meets the needs of all applicants. If you require a reasonable accommodation to make your application or interview experience a great one, please contact Pay offered to a successful candidate will be based on several factors including the candidate's education, work experience, work location, specific job duties, certifications, etc. In addition, OpenKyber offers a comprehensive benefits package, including: medical, prescription, dental, vision, AD&D, and life insurance offerings, short-term disability, and a 401K plan (all benefits are based on eligibility). This posting is open for thirty (30) days.

For applications and inquiries, contact:hirings@openkyber.com

Job Tags

Hourly pay, Contract work, Temporary work, Work experience placement

Similar Jobs

University Hospitals

Registered Nurse (RN) ED - (New Grad) Job at University Hospitals

 ...stroke and chest pain certified. \n Click HERE to learn more about the unit and the Nurse Leader!\n Why choose UH as a New Grad RN?\n \n Nurse focused \n Supportive & education focused culture \n Nurse Residency Program to assist in Transition To Practice... 

StevenDouglas

Network Engineer Job at StevenDouglas

 ...Job Description NETWORK ENGINEER \n OPPORTUNITY: Contract-to-Hire \n LOCATION: Fort Lauderdale, FL (Onsite)\n NOTE: Local candidates only \n \n SUMMARY \n The Network Engineer implements, maintains, and supports the companys US network environment... 

C C CLARK INC

Warehouse Picker - Versailles, KY Job at C C CLARK INC

 ...safely operate a rider pallet jack and forklift. Position Specifics: Pay Rate: $16.20 per hour Hours/Days of Work: Monday through Friday, Day Shift Location: Versailles, KY Essential functions: Pick products according to voice to pick system instructions... 

GIRIKON, INC

Salesforce Developer Job at GIRIKON, INC

 ...Health insurance Paid time off Vision insurance Dental insurance Girikon is looking at hiring a full-time Salesforce Developer with following job description: Consultant will join our team only after the successful completion of Background check... 

uBreakiFix

Entry Level - Electronics Repair Technician & Sales Job at uBreakiFix

 ...Job Description Job Description Tech Repair Expert, ubreakifix We help people do more with their technology and stay connected...  ...leading 1 year repair guarantee. ubreakifix handles everything from phones and gaming consoles, to cameras, laptops, and computers. Let the...