Hiring: Senior Databricks Engineer (PySpark + Data Lake)
Location: NJ / Plano, TX (5 Days Onsite Any JPMC Office Location)
Employment Type: W2
Duration: Long-Term Contract
Openings: 5 Positions
We are actively hiring experienced Senior Databricks Engineers to support a large-scale data modernization initiative. This role focuses on migrating legacy ETL workflows from Ab Initio to cloud-native Databricks pipelines using Apache Spark (PySpark).
Key Responsibilities: Analyze and migrate legacy ETL workflows from Ab Initio to PySpark
Design, develop, and optimize scalable data pipelines on Databricks
Build and maintain ETL/ELT pipelines integrating data from Snowflake and other enterprise sources
Support batch and near real-time data processing
Create data lineage, data flow diagrams, and optimize data processes
Develop unit, integration, and reconciliation testing frameworks
Support deployment, migration strategy, and production cutovers
Work with scheduling tools like Control-M
Collaborate with architects, analysts, and business stakeholders for UAT/FAT sign-offs
8+ years of Data Engineering experience
Strong hands-on experience with PySpark and Databricks
Experience with Ab Initio to PySpark migration
Expertise in ETL/ELT pipeline development
Strong knowledge of Data Lakes, Data Warehousing, and Snowflake
Experience in Data Lineage, Data Governance, and Data Quality
Strong coding skills in Python
Experience with batch and real-time processing frameworks
Experience in Banking/Financial Services domain
Experience with cloud platforms like Amazon Web Services / Microsoft Azure
Strong troubleshooting and production support experience
...instructions on newly introduced assignments. MAIN RESPONSIBILITIES: Technical Engineering Services this team operates in an Azure + Databricks Lakehouse. The role requires the following technical skill set Cloud data engineering experience, including: data...
...Overview Cedar Pine seeks an Investment Associate for its private company Investments Team. Investment Associates are key to the team by... ...and investing at a buy-side institution, e.g., a private equity firm or family office. ~ Driven to perform rigorous research with...
...Job category: University Staff Employment type: Temporary (Fixed Term) Job profile: Housekeeper Job summary: Cleans and attends to guest's needs in rooms, including making beds, cleaning bathrooms, and replacing amenities. Stocks supplies and...
...driving measurable earned impact and helping shape the companys corporate and brand narrative as well as leading project management for PR and corporate communications initiatives (ranging from in-culture consumer activations to corporate sustainability and executive...
...COMPANY OVERVIEW KKR is a leading global investment firm that offers alternative asset management as well as capital markets and insurance solutions. KKR aims to generate attractive investment returns by following a patient and disciplined investment approach, employing...