Building Streaming Microservices with Apache Kafka - Tim Berglund
Posts
«Советская колбаса» или Ложь о вкусных продуктах в СССР
«Советская колбаса» или Ложь о вкусных продуктах в СССР : Источник
Jenkins Kubernetes plugin interesting feature
Kubernetes plugin for Jenkins give us interesting ability to run multiple slaves as pods in the same time and execute commands on every of running slaves, moreover it can convert usual container into a slave. All you need is to define template like this: podContainers: [ containerTemplate( name: 'jnlp', image: "${dockerRegistry}/cd/jenkins-slave-python", workingDir: '/tmp', alwaysPullImage: true, resourceRequestMemory: '1Gi', resourceLimitMemory: '2Gi', args: '${computer.jnlpmac} ${computer.name}' ), containerTemplate( name: 'python', image: 'python:3.8-slim', alwaysPullImage: true, ttyEnabled: true, resourceRequestMemory: '1Gi', resourceLimitMemory: '2Gi', command: '', workingDir: '/tmp' ) ], Please, pay attention to the second template definition. It has, from the first look,...
Run Horovod with CPU only
I was interested in running federated model training using Horovod in the Kubernetes cluster. The first question I had was - is it possible to run Horovod on CPU, because our containers don't have GPUs. I found out on GIT repository of Horovod , that this is possible. I have to install within Horovod non-gpu version of Tensorflow, and everything should fly. Also no need to specify GPU settings in the code, like config.gpu_options.allow_growth = True config.gpu_options.visible_device_list = str(hvd.local_rank()) Also, Fardin, advices: If you have GPUs on your machine and do not want to use them set the environment variable CUDA_VISIBLE_DEVICES=-1 .
Categorical Crossentropy vs. Sparse Categorical Crossentropy
I found nice explanation here: https://jovianlin.io/cat-crossentropy-vs-sparse-cat-crossentropy/