Python + PySpark - Junior Developer Job at Compunnel, Inc., New York, NY

Wno1OUQ5UVhPQmc3ZDRTdytCSm9ORk5KcFE9PQ==
  • Compunnel, Inc.
  • New York, NY

Job Description

The Python + PySpark Junior Developer will be responsible for developing scalable data solutions using PySpark and Python. The role requires hands-on experience in data engineering, SQL, and cloud platforms such as AWS or Azure. The candidate should have strong problem-solving skills and experience in building efficient ETL pipelines for large-scale data processing. Key Responsibilities Develop and maintain data processing pipelines using Python and PySpark Design and implement ETL workflows for structured and unstructured data Optimize data storage, retrieval, and transformation processes Work with cloud platforms (AWS or Azure) to deploy and manage data solutions Write complex SQL queries for data transformation and analysis Collaborate with data engineers, analysts, and stakeholders to ensure data integrity and reliability Troubleshoot and resolve performance issues in data pipelines Required Qualifications 5+ years of experience in data engineering Strong proficiency in Python and object-oriented programming Hands-on experience with PySpark for large-scale data processing Proficiency in SQL for data manipulation and query optimization Experience with cloud platforms (AWS or Azure) Knowledge of ETL processes and data warehousing concepts Experience with Hadoop is acceptable Preferred Qualifications Experience in optimizing Spark jobs for performance and efficiency Familiarity with DevOps practices for data engineering Understanding of data governance and security best practices #J-18808-Ljbffr Compunnel, Inc.

Job Tags

Similar Jobs

Efinity Mortgage

Mortgage Loan Officer Assistant Job at Efinity Mortgage

At Efinity Mortgage, located in the vibrant heart of Irving, TX, we pride ourselves on tailoring unique mortgage solutions with a clear...  .... We are excited to announce an opening for a Mortgage Loan Officer Assistant. This role is crucial in supporting our loan officers... 

Pharma340 dba Community Pharmacy

Pharmacy Technician Job at Pharma340 dba Community Pharmacy

 ...Pharmacy is a fast growing, family-oriented group of independent pharmacies looking for a Full Time, up to 40 hours per week, Pharmacy Technician to work at ourCommunityPharmacy in Lake City,IA. We are looking for a dependable Pharmacy Technician that will process and... 

Omega World Travel

Travel Consultant Job at Omega World Travel

 ...Job Description We're Hiring: Experienced Travel Consultants Wanted! Omega World Travel is expanding our team! We're seeking experienced Travel Consultants to serve our military and government customers onsite at locations in the US. If you have a passion for travel... 

SVS Group

Shipping & receiving / Order Picker Job at SVS Group

 ...join our clients warehouse team in the Sacramento area. Pay & Schedule: $20/hr | Full-Time | MondayFriday, 7:00 AM3:30 PM | Temp-to-Hire Job Summary This role is responsible for picking, packing, and preparing warehouse orders for shipment while maintaining... 

Legacy LifeCare | Chelsea Jewish Lifecare

Scheduler - Business Office Admin Support Job at Legacy LifeCare | Chelsea Jewish Lifecare

 ...Start a meaningful career as aScheduler/Business Office Admin Support with Chelsea Jewish Lifecare at our Harriett/Ralph Kaplan Estates...  ...or expression, age, national origin, ancestry, disability, medical condition, genetic information, marital status, veteran or military...