Data Engineer with Databricks

  • Wien
  • Adastra
We are Adastra Digital For more than 20 years, we support the biggest names in the business with cutting-edge digital solutions. Join us and help top companies make better-data-driven decisions. Adastra is an international consulting company that creates functional solutions in various sectors, facilitating the transition to the digital era. Data remains at the core of the company’s activities, which have gradually expanded to include the Clouds Technologies, Internet of Things (IoT), Big Data, Artificial Intelligence, and mobile app development. Job description, responsibilities and duties: Designing and implementing data ingestion pipelines from multiple sources using Databricks Developing scalable and re-usable frameworks for ingesting of data sets Integrating the end to end data pipleline - to take data from source systems to target data repositories ensuring the quality and consistency of data is maintained at all times Evaluating the performance and applicability of multiple tools against customer requirements REQUIREMENTS 1+ year of experience designing, developing, deploying and/or supporting data pipelines using Databricks Bachelors's degree in Computer Science, Statistics, Informatics, Information Systems or another quantitative field. Expertise in designing and deploying data applications on cloud solutions, such as Azure or AWS Hands on experience in performance tuning and optimizing code running in Databricks environment Proficient in programming languages like Pyspark  and Python Good understanding of SQL, T-SQL and/or PL/SQL Demonstrated analytical and problem-solving skills particularly those that apply to a big data environment Experience with big data tools like Hadoop, Spark, Kafka, Scala is nice to have Employee perks, benefits: You will have an immense opportunity and our support to grow professionally, working on leading data analytics projects and technologies You will work in an environment which will stand behind you, support you in your growth, and which will value your work through competitive salary Professional growth, Adastra Teambuilding activities , Family-oriented benefits,  Adastra Academy - wide range of leading-edge trainings & certifications, workshops, language courses  Information about the selection process We look forward to working with you, and you becoming an Adastran! In case of interest, do not hesitate to send us your Curriculum Vitae in English language. We appreciate your interest , and please be advised that we will only be contacting candidates who closely match the specific profile we are seeking. Thank you for your understanding.