Dettagli della offerta

We are looking for a Data Engineer for our Data Lab area . The resource will be responsible for the design, development and maintenance of end-to-end data pipelines for Big Data analytics. You will work closely with other engineers and analysts to acquire, transform, analyse and visualise large-scale data. Responsibilities: Design, develop and deploy data pipelines using Apache Spark, Hadoop and other Big Data tools. Develop and maintain ETL (Extract, Transform, Load) to load data from different sources into data warehouse and data lake. Optimise the performance of data pipelines and data storage systems. Collaborate with data scientists and analysts to understand their needs and develop data analysis solutions. Develop and maintain reports and dashboards for data visualisation. Ensure data quality, security and integrity. Keep up-to-date on Big Data technologies and analysis tools. Key requirements: 2 years working experience as a Data Engineer. Hands-on experience with Apache Spark, Hadoop, Hive, Pig and other Big Data tools. Experience with GCP (Google Cloud Platform) and managing data warehouse and data lake on cloud. Knowledge of SQL and scripting languages such as Python or Bash. Ability to design and develop end-to-end data pipelines. Capacity to optimise the performance of data pipelines and data warehouse systems. Capability to work independently and as part of a team. Qualifications: Bachelor's degree in Computer Science, Computer Engineering or Mathematics. Professional knowledge of the English language. Desirable experience: Experience with GCP (Google Cloud Platform) and managing data warehouse and data lake on cloud. Experience with machine learning and deep learning tools. Knowledge of Docker and Kubernetes. Experience with CI/CD (Continuous Integration/Continuous Delivery). Location: Naples and Milan J-18808-Ljbffr


Salario Nominale: Da concordare

Risorsa: Adzuna_Ppc

Funzione Lavorativa:

Requisiti

Academy Developer Back/Front End - Napoli

Figura professionale in uscita: Sviluppatore Front End / Back End. Il corso ha l'obiettivo di trasferire i concetti teorici e pratici su questi temi: CSS /...


Buscojobs - Italia

Pubblicato 6 days ago

Back-End Engineer | .Net 8, Api Rest, Sql Server

Country : Italy Cities : Cagliari, Florence, Napoli, Perugia Are you a software development enthusiast? So are we! In Avanade, as the leading partner of Mic...


Buscojobs - Italia

Pubblicato 6 days ago

Full-Stack Developer Con Competenze In Ai

Fmts Lavoro Srl, Agenzia Per il Lavoro e di somministrazione (Aut. Min. R. 0000002 del 05.01.2021) ricerca e seleziona per nota azienda cliente : FULL-STACK...


Buscojobs - Italia

Pubblicato 6 days ago

Datacenter Integration Sourcing Manager

Microsoft Cloud Operations and Innovation (CO+I) is the team behind the cloud. We are responsible for delivering over 200 Microsoft web portals, Live and Onl...


Microsoft - Italia

Pubblicato 6 days ago

Built at: 2025-01-26T02:39:07.197Z