Releases: gearpump/gearpump
Releases · gearpump/gearpump
Release Gearpump 0.9.0
This is first release after Gearpump retired from Apache Incubator. Here are notable changes.
- Change groupId to io.github.gearpump
- Upgrade sbt to 1.2.7 (#2115)
- Upgrade sbt-assembly to 0.14.9 (#2114)
- Upgrade sbt-pack to 0.11 (#2113)
- Upgrade sbt-unidoc to 0.4.2 (#2111)
- Update license headers (#2108)
- Upgrade to Scala 2.12 (#2106)
- Update sbt-scoverage to 1.2.0 (#2067)
- Remove ScalaJs module (#2102)
- Update scalatest to 2.2.6 (#2066)
- Update scalacheck to 1.11.6 (#2065)
fix GEARPUMP-186 Create 0.8.1 release
Author: Kam Kasravi <kamkasravi@yahoo.com> Closes #70 from kkasravi/GEARPUMP-186.
0.8.0
Apache Gearpump 0.8.0
Apache Incubation:
Apache Gearpump enters Apache incubation. Now, we are working on importing the source code to Apache Git (INFRA-11435), and
a bunch of other tasks (GEARPUMP-1).
Apache Gearpump Jira: https://issues.apache.org/jira/browse/GEARPUMP
Mail list:
- Subscribe link to User list: user-subscribe@gearpump.incubator.apache.org
- Subscribe link to Dev list: dev-subscribe@gearpump.incubator.apache.org
- Subscribe link to Private list: private-subscribe@gearpump.incubator.apache.org
- Subscribe link to commits list: commits-subscribe@gearpump.incubator.apache.org
What are the changes for the process for Apache Incubation?
The code importing to Apache Git is still in process. During this transtion time,
We will follow these procedures:
- For new issue, we should no longer open issue in Github issues. Instead, we
need to open an issue at Apache Jira: https://issues.apache.org/jira/browse/GEARPUMP - Pull Requests are still submitted to http://github.com/gearpump/gearpump for review.
- We should cross post the link of PR to Jira site, and Jira link to Pull Request context.
- Code will still be commited to https://github.com/gearpump/gearpump
- During this transition time, document change doesn't require a +1 if it comes from committers.
- The release tag requires a consensus in project discussion like sync-meeting. But it doesn't
additional "+1" on code commit.
For example, we will ask around that whether it is OK to trigger a tag; if every one agrees,
then the assignee can tag the build and change the release doc directly without a written "+1" on the commit.
After the transition period, the proposed process is like this:
- The official repo will be at git://git.apache.org/gearpump.git, all other repos will be
mirror of this repo. - We will disable "write" in github issues, and switch to Apache Jira.
- We will enable Apache Github integration, which allow us to mirror official Git repo in Github.
- When the user submit a PR, there should be at least one +1 before doing merge.
- For all commits, the commit should commit the path manually to official repo
git://git.apache.org/gearpump.git, "Github merge" will be disabled. - For document change, we can have further discussion on whether it should requires a +1.
Before completing importing source code to Apache Git, we will still use
Why we make a tag release now, but not wait until Apache importing complete?
There are quite a lot of open task at https://issues.apache.org/jira/browse/GEARPUMP-1, which
would take a significant time. For example, we still don't have the new maven artifact yet.
Making incremental releases like this one allow us to be more prepared to make a full Apache release.
Highlights:
- Update Akka to Akka 2.4.2 (#1988). Now we only support Java 8 and Scala 2.11, Java7, Scala 2.10 support is dropped
(Be compatible with Akka 2.4.2). The performance of Gearpump 0.8.0 is as good at Gearpump 0.76. - Fix Min clock slow-advancing issue (#1318) when some graph edge (Possibly means networking between two hosts) don't
have enough traffic. - Add OAuth2 social login for UI server.
Lowlights:
Akka-stream DSL module is temporary disabled, as Akka-Stream 2.4.2 has big API change compared with Akka-Stream 1.0. We'd
like to add the full functional module back in next release.
Change log:
From now on, new issues should be submitted to https://issues.apache.org/jira/browse/GEARPUMP
- GEARPUMP-10, Downgrade netty from Netty 4 to Netty 3.8 cause the OAuth2 authentication failure
- GEARPUMP-9, Clean and fix integration test
- GEARPUMP-8, fix "two machines can possibly have same worker id for single-master cluster"
- GEARPUMP-6: show add/remove worker buttons for admin
- GEARPUMP-5, Add additional authorization check like checking user-organization for cloudfoundry OAuth2 Authenticator.
- GEARPUMP-3, Define REST API to add/remove worker instances, which allow us to scale out in YARN.
- GEARPUMP-2, Define REST API to submit job jar
- #1988, upgrade akka to akka 2.4.2
- #2015, do not send AckRequest or LatencyProbe when no pending messages
- #1943 allow user to config how many executors to use in an application
- #1641, add exactly-once it
- #1318, fix MinClock not updated fast enough for slow stream
- #1981, Support OAuth2 Social login
- #2007, add Java DSL
- #2002, add akka stream examples
- #1996, EmbeddedCluster requires master configuration like ClusterActorRefProvider.
- #1989: add confirmation dialog for kill app and restart app
- #1983, fix KafkaUtilSpec failure
- #1975, fix storm integration test
- #1972, backoff retry kafka consuming on exception
- #1966 make Partitioner API Java compatible
- #1892: added instruction text to operate network graph (2) minor tweaks of context menu
- #1963, rename CommitGuideline.md to CONTRIBUTING.md
- #1958: better test report organizing
- #1906: some visual glichtes found in mobile view
0.7.6
Gearpump 0.7.6
Highlights:
- #1648 Support submit storm jar via dashboard
- Support StreamCQL over Gearpump
Change log:
- #1924, fix storm test spec failure
- #1926, fix client side configuration does not work in CGroup
- #1648, support submit storm jar via rest interface
- #1933, Fixes some of the documentation typos, adds SBT configuration
- #1936, allow user to config kafka source start offset time
- #1777, Dynamic DAG failed after changing parallelism for many times
- #1932, Fix client config overwrites critical system config
- #1895, make GearpumpNimbus a standalone service
- #1910, enlarge timeout in MasterClient
- #1952, document how to use StreamCQL over Gearpump
0.7.5
Gearpump 0.7.5
Highlights:
- #1723, Add an experimental cgroup module for CPU isolation.
- #1767, Add docs and implementation to support storm 0.10.
- Make UI mobile phone friendly.
Change log:
- #1919, fix AppMasterSpec
- #1723 add an experiment module to do cgroup CPU isolation.
- #1913, add warning for detected loop in DAG.
- #1896, move storm examples under integration test
- #1897, increase akka logger start up timeout for unit test
- #1843 Add a Rest service to launch a new worker
- #1904, fixed "DAG canvas context menu cannot be displayed."
- #1898: in integration test, there need a retry attempting for login
- #1882: extract the tool tip string to externalized file
- #1837, Use java.net.preferIPv4Stack to force IPv4
- #1885, Shorten the table view when disabled in mobile.
- #1883,URL redirection error when accessing index.html
- #1874, Format the login failure message to more readable format.
- #1876, Shell command yarnclient should use 1 as the the default count for "addWorker"
- #1877, Fix several navigation issues on Mobile phone
- #1830: removed cluster side menu and tuned main navbar
- #1681: show application last error in overview page
- #1866, use geardefault.conf to replace reference.conf to avoid confusion
- #1767, Add docs and implementation to support storm 0.10
- #1868: show correct data points when switch historical view and recent view.
- #1864, Add robots.txt to disable search engine crawling
- #1860, add licenses for included source and binary libraries.
- #1804, fix UI authentication document page format
0.7.4
Gearpump 0.7.4
Change log:
- #1247, add authentication for UI
- #1855: when service is unavailable, do not query models without waiting.
- #1833 update performance related doc
- #1831, Services exits on bind failure
- #1779: show critical path latency for application
- #1733 dynamic dag fall back to last dag version in case of Master HA
- #1804, fix navbar on mobile
- #1713 regression on HBaseSink
- #1838 YARN failure trying to contact YarnAppMaster when launched in YARN
0.7.3
0.7.2
0.7.1
Gearpump 0.7.1
Highlights:
- #1411. new UI experience. now the frontend UI can safely support applications with tens of thousands to tasks.
- #1514 Add Akka-stream 1.0 experimental module
- #1698, refactor on yarn experiment module, with bug fixes, and enhanced functions, like dynamically adding/removing machines.
- #1679, fix dynamic dag bug (fail to transit)
- #1547, add a SequenceFileSink
Change logs:
- #1761, add more source comments and fix several typo
- #1799, amend two PROXY typos in files
- #1411: new UI to allow to scale to thousands of tasks.
- #1794, split dispatchers of Task and Netty
- #1018 transfer Any in Message
- #1792, fix storm module config conflict
- #1785, [yarn] UI daemon process cannot be terminated
- #1789 fix DynamicDagSpec
- #1784, document the limitation of yarnclient command line.
- #1778, AppSubmitter "-config" option is not used
- #1782, add doc to run storm over Gearpump application on yarn
- #1774, remove MaxPermSize JVM option as JDK8 no longer support it.
- #1772, When upload application in UI, custom config file is not effective
- #1770, processor metrics is aggregated in wrong way
- #1768, TaskFilterAggregator is not working
- #1763, change all GearPump to Gearpump
- #1411: metrics charts would not update after 15 seconds
- #1756, add HistoryMetricsConfig for master info and worker info
- #1754 standardize archive name
- #1753 update server channel group name
- #1747: storm spec failure due to parse application id
- #1747: updated the way to parse application id in command-line
- #1743, fixing some typo in the example folder
- #1744, Separate global config and application specific config, allow to config log level for specific
class. - #1734, handle smoothly when more resources are allocated than required.
- #1698, refactor on gearpump-yarn experiment module
- #1716: enable code coverage check for master branch
- #1720, support automatic integration test
- #1719 unhandled PutKVSuccess in Master
- #1714: some navbar visual issues
- #1499, Aggregate the metrics on server
- #1711: layout is more responsive on small devices
- #1679 dynamic dag will fall back when replacing a processor failed
- #1707, support html test report in integration test
- #1670, regression, change taskActor back to use stashing.
- #1703: task metrics in bar chart were empty
- #1701: wrong dirty check of modify processor and more
- #1384: rest service url was not set correctly
- #1682: allow specify a transition time when changing parallelism
- #1691: dashboard layout and textual changes and update to dashing…
- #1640 YARN deployment - no easy way of obtaining master address…
- #1688, Reduce unimportant logs in travis UT console
- #1671, make default timeout shorter to be more UI responsive.
- #1685, Should not publish gearpump-integration-test to maven
- #1683, Allow metrics to be aggregated before sending to UI
- #1223: will mark application with a warning when stalling task de…
- #1670, #1653, fix dynamic dag bug
- #1659 add a rest api to terminate service process
- #1672: when worker is killed, its detail page will no longer be updated
- #1660 remove Try block,give debug info to user instead.
- #1666: will should application details (and load metrics afterwards)
- #1651, fix change processor's parallelism on dashboard
- #1536, fix storm at least once support
- #1655: added a test case for replacing a processor
- #1653 fix replacing a processor
- #1639 refine daemon's classpath
- #1652, submit app with no arguments from dashboard returns warning
- #1547 add a SequenceFileSink
- #1424: when application is terminated, related status indicators …
- #1645: parse appid in submission response better
- #1514, add an experimental module to support akka-stream 1.0
- #1643, fix UI timeout issue when metrics is disabled
- #1632 Remove duplicate of repository
- #1630, StormBoltOutputCollector skips reporting on ack disabled
0.7.0
Gearpump 0.7.0
Highlights:
- New end-to-end integration test, better test coverage (#1243 Thanks to contribution by Stanley, Tianlun, Huafeng, Kewei)
- Storm binary compatibility. (still has some limitation)
- New Document site(#1506).
- Secure YARN and secure HBase support(#1458)
- spray is replaced by akka-http (#1261)
- New serialization implementation(#1445 allow user to custom a serialization framework).
Change log:
- #1627, refine on custom serialization doc.
- #1624, fix the worker report resource timeout settings.
- #1384: removed wrong page redirection
- #1243: provide an integration test suite
- #1607 fix NONE_SESSION when restart tasks
- #1609, fix storm message timestamp bugs
- #1579 Additional documentation changes
- #1536, support storm ack
- #1581, fix HadoopCheckpointStore
- #1506 Totally reorganize documentation
- #1538 fix yarn application classpath
- #1519 fix performance regression
- #1485 no more pending messages in ExpressTransport
- #1458, enable secured HBase
- #1496, fix StormSerializer Kryo buffer overflow
- #1478: click on location button will copy text to clipboard
- #1491, fix ContainerLaunchContextSpec
- #1489, remove terminated executor from ExecutorManager
- #1481, improve storm over gearpump perf
- #1479: add uptime field in service interface
- #1481, fix storm performance
- #1482, fix TaskScheduler over schedules when multiple executors down at once
- #1458 support launching Gearpump in secured Yarn cluster
- #1476 fix serialization in transport layer
- #1470: updated a broken dashboard dependency
- #1463, fix storm config
- #1465 fix DistributedShell
- #1462 pass user config to SerializerPool
- #1453: allows use DEL to remove processor/edge-
- #491: Added support for composing DAG from scratch
- #1449 fix copy file to local in LocalJarStoreService-
- #1387 decouple serializer for Message
- #1445 refactor serialization implementation
- #1343, support Storm emitDirect and DirectGrouping
- #809: static resources are now sent to client gzipped
- #1438: polished modify processor dialog
- #1423: show full error log in a popup
- #1423: show error message when uploading is failed and polished the dialog
- #1430: turn off illegal header warning
- #1428, add unidoc plugin which allow us to build the scaladoc for the whole project(include all sub-projects)
- #1228, add data source and data sink for java api
- #1228, further simplify the java interface
- #1422: removed if-modified-since header. it is not relevant and is handled very different by different web servers
- #1228, add java interface for Graph API
- #1411: chart will always fill data points for 15 minutes
- #1261, #1127, replace spray with akka-http
- #1373 add duplicated edge detecting
- #1412: add 'no-cache' header in ajax responses
- #1194 add graph cycle detection
- #491, add a rest api to acquire Gearpump's built-in partitioners
- #1405: now the number of executors is back
- #1371: a right way to show historical metrics (2) added committed…
- #1402, fix NoneGroupingPartitioner
- #1399: in application overview page the task count of executor wa…
- #1397, allow KafkaSink to receive Message of bytes
- #1395, cross publishSigned
- #1374 remove jars of yarn in executor's classpath
- #1266: should exclude dead edges
- #1238, adds BroadcastPartitioner
- #1381 test on travis out of memory
- #1379, support storm tick tuple