Our client operates in healthcare area. Data is usually delivered to the team already in CSV format, but occasionally conversion to CSV (from Excel or Paradox) is needed, requiring flexibility and a pragmatic approach to finding a solution. For example, team came up with an innovative way to run Wine on Ubuntu to convert an old database format to CSV as the conversion program was Windows only.

• We want someone to come in to own the Data Migration function and help us improve our current system with recommendations and ongoing optimization
• We use Ruby for processing, filtering and sorting CSV data and outputting JSON data ready for loading. If you know another language like Python or JavaScript, that will likely be fine if you can pick up Ruby quickly.
• We use RSpec for our main application and would want this to be used for the data migration system as well.
• We often load CSV data into Postgres for faster sorting and querying during the conversion process
• You will be communicating with customers over email and phone, and they often have questions/worries about their migration. Providing reassurance to them is key!

• 2,5+ year of experience in a data engineering role.
• Solid proficiency in a programming language, with experience in building scripts or applications for data processing tasks.
• Good understanding of data structures and databases (both SQL and MongoDB). We don’t use MongoDB but we do import data from it.
• Experience with Linux setup, bash scripting, provisioning (Ansible) and administration (we run secure remote Ubuntu cloud desktops to process the data and upload it to AWS S3 before it’s imported)
• Familiarity with CSV and JSON data formats, including parsing and manipulation techniques.
• Experience with data validation, cleaning, and transformation techniques.
• Demonstrable experience building automated test suites (e.g. to take a CSV file of appointments and test the output, or testing the output of a specific conversion method/function).
• Experience optimizing data conversion performance (for example, when to use Ruby array methods vs database queries for filtering data, or running conversion in parallel across multiple cores)
• Experience with setting up Postgres databases.
• Strong communication and collaboration skills, with the ability to work effectively in a team environment.
• Upper-intermediate English level.

• Ownership – we trust that you will do the right things to deliver maximum impact.
• Transparency – we say what we think and every voice is heard and respected, even when our opinions differ.
• Service – whether it’s for our customers or teammates, we always support each other.
• No bureaucracy, no micromanagement.
• Flexible working schedule – you plan your working day based on your tasks and meetings.
• Corporate events and various team buildings.
• Sigli Academy: Initial Training Programs, How it Works & more.