Data Engineer
Duration: 12 Months
Location: Saint Lois, MO/ Dallas, TX/ New York, NY/ Last option is remote
Position
We are seeking a skilled Data Engineer with strong expertise in Python, PySpark, AWS Glue, Databricks, and Data Lake technologies. The ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines, data lake architectures, and cloud-based analytics solutions that support enterprise reporting, business intelligence, and advanced analytics initiatives.
Key Responsibilities
Design and develop scalable ETL/ELT pipelines using Python, PySpark, AWS Glue, and Databricks.
Build and maintain enterprise Data Lake solutions for structured, semi-structured, and unstructured data.
Develop data ingestion frameworks for batch and near real-time processing.
Create and optimize data transformation workflows to support analytics and reporting requirements.
Collaborate with business analysts, data architects, and stakeholders to understand data requirements.
Implement data quality validations, reconciliation processes, and monitoring solutions.
Optimize Spark jobs and Databricks workloads for performance and cost efficiency.
Develop reusable frameworks, libraries, and best practices for data engineering teams.
Support cloud migration and modernization initiatives.
Troubleshoot and resolve data pipeline failures and performance bottlenecks.
Ensure data security, governance, and compliance standards are maintained.
Required Technical Skills
Programming & Data Processing, Python, PySpark, SQL, Data Modelling, ETL / ELT Development, Cloud & Big Data, AWS Glue, AWS S3, AWS Lambda, AWS EMR (Preferred)
AWS Redshift (Preferred)
AWS IAM
Databricks
Databricks Workspace
Delta Lake
Spark Structured Streaming
Unity Catalog
Job Orchestration
Performance Optimization
Data Lake Technologies
Data Lake Architecture
Delta Lake
Medallion Architecture (Bronze, Silver, Gold)
Data Governance
Metadata Management
Database Technologies
Snowflake (Preferred)
PostgreSQL
SQL Server
Oracle
DevOps & CI/CD
Git
Azure DevOps / Jenkins
CI/CD Pipelines
Terraform (Preferred)
Preferred Qualifications
Experience with Healthcare, Insurance, Financial Services, or Retail domain.
Hands-on experience in cloud migration projects.
Experience with real-time data processing using Kafka or Kinesis.
Knowledge of Data Governance and Master Data Management.
Understanding of Data Warehousing concepts and dimensional modelling.
Ibraheem Mohammad
Momento USA | Exceeding Customer Expectations
Email: ibraheem@momentousa.com
440 Benigno Blvd, Unit#A 2nd Floor. Bellmawr, NJ 08031
Interstate Business Park
Direct: 856-452-8848
Web:
Note: Momento USA is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, gender identity, national origin, age, protected veteran status, or disability status.
...badass and work where the real cooks in Bozeman come to play! Prep cook positions involve the making of our menu items, all from... ...Montana Ale Works where our mission is to: Offer exceptional food and drink. Deliver superior service and hospitality. Do it...
...Were looking for a American Airlines Ramp Agent to perform daily responsibilities with dedication. Stay adaptable in a dynamic, fast-paced environment. Provide excellent interactions with customers and colleagues. Perks include competitive pay, flexible schedules, hands...
...Job Description Job Description Entry Level / Apprentice Electrician Opportunities in the Sterling Heights, MI. Area. An advanced... ...Electricians looking for a company that offers excellent pay, medical, and a great home/life balance! Apprentice Electrician rates...
...Benefits: Paid time off Glass installer needed for immediate opening. Looking for a reliable and hardworking individual. Experience preferred but will train. Health insurance, dental, vision and matching 401k benefits offered. Valid driver's license required. Bring...
...Proficient with power and hand tools. Ability to carrying glass (up to 80lb) Load and unload glass panels as required by project needs Fabricating aluminum window frames, cutting & installing glass materials. Read and interpret plans. Interface with customers...