tree 7b89b6b9f21be0a167fa5c2b1dad880faf612084
parent 3fd456a0554d1c77a70a630b7aa73929f508a045
author lakshmi-manasa-g <mgaduputi@linkedin.com> 1606808241 -0800
committer GitHub <noreply@github.com> 1606808241 -0800
gpgsig -----BEGIN PGP SIGNATURE-----
 
 wsBcBAABCAAQBQJfxfKxCRBK7hj4Ov3rIwAAdHIIAHPGx36JziwKBfSzxGN9mpQ6
 pZ2zAI1owzwhLbAJh7Le2GDftjMauV4q88bN/WdW4I0oL6/7rlaGkNVdfuyF26We
 lt/FNYdhIlVyHvvMYG77xfA2/3p5OVRz2Xf7P+QQbJEVSA0owmbTt4SIyBdUn3kj
 qcsrqUbCQlxqx83Xe4JwtCe9lrPdpRgdYie89pscbr27/qI42IcltM6e7O+ZepF6
 zCTfWBcfftZCdAJ5Myue9eRS2C4/zSdMH0QIRaRR6YcjsCpuKYAP+ZwQ9d/qZR6u
 4lC3zkqPBxo4fqL+0IuxuL9jt9ljPkW2VyOjoZClLP8MnZz+ZW9W5I2CAyjwMjE=
 =EUBp
 -----END PGP SIGNATURE-----
 

SAMZA-2604: Datamodel change to capture physical container id for AM HA (#1445)

Feature:
Main feature is Cluster based Job coordinator (aka AM) high availability. The feature ensures that the new AM can establish connection with already running containers to avoid restarting all running containers when AM dies. This PR enables capturing of the physical execution environment container id (ex: yarn container id "container_123_123") mapping to Samza logical processor id (ex: "0"). In future PRs, this mapping will be used by the new AM.

Changes:
Introduce new Coordinator Stream Message and manager to read/write this message
Container upon launch will write to c-stream, its logical and physical id
Job Coordinator(AM) upon launch will read the mapping of all containers from c-stream.

Tests:
added unit test for new manager
working on tests for other classes as they have no coverage for relevant code.

API changes:
New c-stream message

Usage instructions: None

Upgrade instructions: Backwards compatible. N/A