Skip to content
This repository has been archived by the owner on Oct 11, 2023. It is now read-only.

Including endpoints in saves for offsets #30

Open
wants to merge 58 commits into
base: develop
Choose a base branch
from

Conversation

knordstrom
Copy link
Contributor

@knordstrom knordstrom commented Jul 24, 2017

Types of changes

  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds functionality)

I marked feature but neither really fit. Technically this is a third category, ie.

  • Breaking change that provides enhanced functionality

Description of the change

Offsets are now saved with a key that includes the IoTHub endpoint so that multiple IoTHubs may be tracked using the same datastore.

Motivation for the change

See discussion here #24


This change is Reviewable

Keith Nordstrom added 30 commits March 7, 2017 17:41
* Changed default namespace to an underscore-separated value
* private[iothubreact] Configuration object => (public) final class
* Configuration instance passed as implicit throughout application from IOTHub class, which establishes a default
* Added unit test for Configuration changes
* new test dependency on mockito
* styling
* reducing footprint throughout codebase of implicit config
* trait based DI
* Changed default namespace to an underscore-separated value
* private[iothubreact] Configuration object => (public) final class
* Configuration instance passed as implicit throughout application from IOTHub class, which establishes a default
* Added unit test for Configuration changes
* new test dependency on mockito
* styling
* reducing footprint throughout codebase of implicit config
* trait based DI
* Changed default namespace to an underscore-separated value
* private[iothubreact] Configuration object => (public) final class
* Configuration instance passed as implicit throughout application from IOTHub class, which establishes a default
* Added unit test for Configuration changes
* new test dependency on mockito
* styling
* reducing footprint throughout codebase of implicit config
* trait based DI
Removing a default in favor of an implicit test declaration


Conflicts:
	build.sbt
	src/main/scala/com/microsoft/azure/iot/iothubreact/checkpointing/backends/cassandra/lib/Connection.scala
	src/main/scala/com/microsoft/azure/iot/iothubreact/javadsl/IoTHub.scala
	src/main/scala/com/microsoft/azure/iot/iothubreact/scaladsl/IoTHub.scala
	src/main/scala/com/microsoft/azure/iot/iothubreact/scaladsl/IoTHubPartition.scala
	src/test/scala/api/API.scala
* CheckpointService config abstracted for usage multiple places
* Offset commit sink added
* added to integration test, though not yet directly tested in this project
Conflicts:
	README.md
	build.sbt
	samples-java/pom.xml
	samples-scala/src/main/scala/A_APIUSage/Demo.scala
	src/main/scala/com/microsoft/azure/iot/iothubreact/MessageToDevice.scala
	src/main/scala/com/microsoft/azure/iot/iothubreact/checkpointing/Backends/cassandra/lib/Auth.scala
	src/main/scala/com/microsoft/azure/iot/iothubreact/checkpointing/CPConfiguration.scala
	src/main/scala/com/microsoft/azure/iot/iothubreact/checkpointing/CheckpointService.scala
	src/main/scala/com/microsoft/azure/iot/iothubreact/checkpointing/backends/AzureBlob.scala
	src/main/scala/com/microsoft/azure/iot/iothubreact/checkpointing/backends/CassandraTable.scala
	src/main/scala/com/microsoft/azure/iot/iothubreact/checkpointing/backends/CheckpointBackend.scala
	src/main/scala/com/microsoft/azure/iot/iothubreact/checkpointing/backends/cassandra/lib/Connection.scala
	src/main/scala/com/microsoft/azure/iot/iothubreact/javadsl/IoTHub.scala
	src/main/scala/com/microsoft/azure/iot/iothubreact/scaladsl/IoTHub.scala
	src/main/scala/com/microsoft/azure/iot/iothubreact/scaladsl/IoTHubPartition.scala
	src/main/scala/com/microsoft/azure/iot/iothubreact/sinks/MessageToDeviceSink.scala
	src/test/scala/api/API.scala
Keith Nordstrom and others added 27 commits May 15, 2017 19:45
* named magic number in scala example app
* formatting fix
…s are hashed in the storage backend. Some refactoring and additional DI included to support a test.
Conflicts:
	CHECKPOINTING.md
	README.md
	build.sbt
	samples-java/src/main/java/DisplayMessagesWithAcknowledgement/Main.java
	samples-java/src/main/java/SendMessageToDevice/Main.java
	samples-scala/src/main/scala/A_APIUSage/Demo.scala
	samples-scala/src/main/scala/E_Checkpoints/Demo.scala
	samples-scala/src/main/scala/OSN/Demo3_Checkpoints.scala
	src/main/scala/com/microsoft/azure/iot/iothubreact/SourceOptions.scala
	src/main/scala/com/microsoft/azure/iot/iothubreact/checkpointing/CheckpointOnPull.scala
	src/main/scala/com/microsoft/azure/iot/iothubreact/checkpointing/CheckpointService.scala
	src/main/scala/com/microsoft/azure/iot/iothubreact/checkpointing/OffsetLoader.scala
	src/main/scala/com/microsoft/azure/iot/iothubreact/checkpointing/backends/cassandra/CheckpointRecord.scala
	src/main/scala/com/microsoft/azure/iot/iothubreact/config/ConnectConfiguration.scala
	src/main/scala/com/microsoft/azure/iot/iothubreact/javadsl/IoTHub.scala
	src/main/scala/com/microsoft/azure/iot/iothubreact/scaladsl/IoTHub.scala
	src/main/scala/com/microsoft/azure/iot/iothubreact/scaladsl/IoTHubPartition.scala
	src/test/scala/api/API.scala
	src/test/scala/com/microsoft/azure/iot/iothubreact/SourceOptionsTest.scala
	src/test/scala/com/microsoft/azure/iot/iothubreact/checkpointing/OffsetLoaderTest.scala
	src/test/scala/it/AllIoTDeviceMessagesAreDelivered.scala
@knordstrom
Copy link
Contributor Author

Sorry about the long delay, there were other things that took me away for a bit. It looks to me like this was ready but the hashing we agreed to in the discussion was not implemented. Is that accurate or was there something else?

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants