TL; DR We have built Zeppelin v0.10.0 Docker images which can be used in Kubernetes with Spark. You can just start over with our yaml file in Kubernetes after building the images with this script. As a bonus feature, you can set up S3 connections in Spark jobs if required. Hi, I…

Sustainability in IT became an important topic last years, since every economic sector tries to make its contribution to the environment protection and reduce its own impact on it. …

The border between backend and frontend development slowly fades out. Being a frontend developer you should often understand and implement solutions on the level of API and client-side communication. Otherwise AWS gives frontend developers enormous ready-to-use solutions making it possible to build completely backendless modules. …

This is the series of posts about Apache Spark for data engineers who are already familiar with its basics and wish to learn more about its pitfalls, performance tricks, and best practices. And in this first part we’ll consider partitioning — the key to a better performance of a large…

Time tracking is a quite common thing nowadays and not only in IT but everywhere where it’s needed to track working hours of employees. Some companies use it for analytics and reporting, others for calculating bonuses and overtime payments, some for controlling and overview. …

This article would be interesting for everyone who is going to pass any AWS exams soon and CSAP particularly. Preparation The peculiarity of this type of exam is that knowing superficially some main services (as it would be for CSA Associate) is not enough. You should: understand more services and much…

Last year I was working on improvement of deployment pipelines for a large live application, which has as usual plenty of new features and bugs. And it’s very important in such projects to consider development flows and choose a right one according to the product and business needs. …

If you work with clouds for a while, you probably know that “I’m definitely missing something” feeling. There can be some not terminated EC2 instance still running, some unjustified settings that you forgot to set back, some test buckets are not deleted, some not covered security issues. All of that…