Notepad

A notepad of unordered stuff

Like that bargain-bin drawer at the department store

AWS

Tags

To assign tags to instances aws ec2 create-tags --resources xxxxx --tags Key=yo,Value=yo Key=el,Value=queLlama

Kafka

ProducerConfig properties for the KafkaMirror

  • batch.size
  • bootstrap.servers
  • buffer.memory
  • client.id
  • compression.type
  • connections.max.idle.ms
  • interceptor.classes
  • key.serializer
  • linger.ms
  • max.block.ms
  • max.in.flight.requests.per.connection
  • max.request.size
  • metadata.max.age.ms
  • metric.reporters
  • metrics.num.samples
  • metrics.sample.window.ms
  • partitioner.class
  • receive.buffer.bytes
  • reconnect.backoff.ms
  • request.timeout.ms
  • retry.backoff.ms
  • send.buffer.bytes
  • value.serializer

ProducerConfig properties for the KafkaMirror

  • auto.commit.interval.ms
  • auto.offset.reset
  • bootstrap.servers
  • check.crcs
  • client.id
  • connections.max.idle.ms
  • enable.auto.commit
  • exclude.internal.topics
  • fetch.max.wait.ms
  • fetch.min.bytes
  • group.id
  • heartbeat.interval.ms
  • interceptor.classes
  • key.deserializer
  • max.partition.fetch.bytes
  • max.poll.records
  • metadata.max.age.ms
  • metric.reporters
  • metrics.num.samples
  • metrics.sample.window.ms
  • partition.assignment.strategy
  • receive.buffer.bytes
  • reconnect.backoff.ms
  • request.timeout.ms
  • retry.backoff.ms
  • send.buffer.bytes
  • session.timeout.ms
  • value.deserializer

UPDATE 21/03/2018 If you want a clearer picture of what each one does, you can take a look at this post from Elastic, carefully and bearing in mind the differences there may be. Kafka input configuration options

Tungsten Replicator

Filtering tables at the source

With this command we run an update on the channel at the source and have filtering enabled, specifying that:

  • the filtering happens at the source > --repl-svc-extractor-filters=replicate
  • we only pull in this schema >--property=replicator.filter,replicate.do=dev_SCHEMA

tpm update alpha --hosts=master --repl-svc-extractor-filters=replicate --property=replicator.filter,replicate.do=dev_SCHEMA

Ansible

Running commands remotely

With this command we run commands remotely, handy for checking the state of something in one shot: `ansible [grupo de servidores] -b -i env/dev/hosts -a “df -h “``

Markdown

Converting YouTube videos to Markdown

At this link http://embedyoutube.org/, you drop in the video and it converts it to markdown. Done with the Kubernetes video.

Links: Kafka: Class ProducerConfig Kafka: Class ConsumerConfig Tungsten: Enabling / Disabling filters

⬆︎TOP