Responsibilities : Work with business users to understand business requirementsTranslate business requirements to technical designsImplement technical architectures using best practicesDesign and implement highly scalable, resilient, available and maintainable systemsPut implementations into production and provide production supportMentor junior engineers Qualifications Required Technical Skills Bachelor of Science in Computer Science or related fields.
5+ years designing, implementing and supporting big data pipelinesSolid experience developing with languages like Java, Scala, PythonSolid experience with Linux skills like CentOS, Ubuntu, shell scripting, light adminSolid experience with DB skills like Oracle, Postgres, JDBC, SQL, query optimizationSolid experience with middle tier solutions like Tomcat, JEE, Spring, Hibernate, ORMSolid experience with CI / CD tools like svn, git, Jenkins, JUnit, TDDExperience implementing pipelines on cloud providers like AWS, GCP, AzureExperience with NewSQL solutions like Cassandra, Snowflake, Clickhouse, BigQueryExperience with networking concepts like REST, HTTP, TCP / IP, UDP, Load BalancersExperience with SMACK (Spark, Mesos, AKKA, Cassandra, Kafka) stack or equivalentExperience with Hadoop ecosystem including HDFS, Map / Reduce, HiveExperience with streaming solutions like Kafka, Kinesis, SparkExperience with messaging systems like MQSeries, ActiveMQ Nice to have Master of Science or PhD in Computer Science or related fieldsMachine Learning experience with scikit-learn, Numpy, Pandas, CatBoost, lightGBMDeep Learning experience with CNNs, RNNs, Kaggle, Fast.
ai, Keras, PyTorchDevops experience with IaC, Terraform, Docker, Kubernetes, AWS, GCP