You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-14 - 19:29
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack2slot7.osadl.org (updated Sun Apr 14, 2024 00:43:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
42653499394,9cyclictest11050irq/107-eth%d22:31:182
426532993317,2cyclictest0-21swapper/022:16:120
42653299320,24cyclictest0-21swapper/023:50:250
426532993120,10cyclictest426531-21cyclictest23:26:130
426533992820,4cyclictest0-21swapper/123:26:131
42653299275,17cyclictest531064-40gzip00:01:130
42653299272,15cyclictest0-21swapper/022:59:560
426532992720,5cyclictest513096-21cat23:31:130
42653299271,18cyclictest0-21swapper/022:41:510
42653399265,16cyclictest503920-21munin-run23:16:131
426532992618,3cyclictest0-21swapper/023:57:560
42653299251,2cyclictest0-21swapper/000:11:310
42653299251,23cyclictest478343-21munin-run22:31:120
42653299251,22cyclictest493040-21latency_hist22:56:130
42653299251,20cyclictest0-21swapper/023:42:410
42653499249,3cyclictest171rcu_preempt22:41:122
42653299242,21cyclictest0-21swapper/023:13:130
42653299241,20cyclictest0-21swapper/022:05:240
42653399232,12cyclictest530908-21cups-browsed00:01:131
426532992321,1cyclictest0-21swapper/023:16:450
426532992315,1cyclictest475551-21cron22:26:130
42653299230,2cyclictest484327-21cat22:41:130
426532992215,0cyclictest0-21swapper/023:31:140
42653299211,19cyclictest0-21swapper/022:50:590
426534992013,3cyclictest428046-21munin-plugin-st19:41:122
42653399195,1cyclictest11050irq/107-eth%d00:11:131
42653399194,12cyclictest587-21mta-sts-daemon23:31:131
42653299191,18cyclictest0-21swapper/023:53:150
112299190,1rtkit-daemon0-21swapper/021:09:260
42653499180,6cyclictest495595-21wc23:01:132
112299180,3rtkit-daemon1121-21rtkit-daemon21:47:260
112299180,3rtkit-daemon1002-21mta-sts-daemon21:38:272
42653399172,10cyclictest522105-21sh23:46:141
426532991715,1cyclictest0-21swapper/023:06:130
42653499165,7cyclictest522104-21sh23:46:142
42653499160,3cyclictest171rcu_preempt00:41:132
42653399163,4cyclictest11050irq/107-eth%d22:06:131
42653399160,3cyclictest11050irq/107-eth%d22:46:131
42653299165,5cyclictest453427-21latency_hist21:46:130
42653299161,8cyclictest0-21swapper/022:32:240
42653299161,8cyclictest0-21swapper/000:26:490
426532991612,3cyclictest431853-21cron20:56:130
42653299160,12cyclictest472725-21munin-run22:21:130
42653499151,11cyclictest506916-21idleruntime-cro23:21:132
42653499150,5cyclictest547216-21latency_hist00:36:132
42653399158,4cyclictest0-21swapper/123:01:131
42653399152,8cyclictest478344-21grep22:31:121
426533991511,3cyclictest0-21swapper/100:16:131
426532991515,0cyclictest0-21swapper/021:52:590
112299150,2rtkit-daemon1121-21rtkit-daemon19:35:590
42653599144,7cyclictest0-21swapper/323:26:133
42653599143,3cyclictest0-21swapper/323:40:113
42653599142,4cyclictest0-21swapper/320:41:133
42653599142,4cyclictest0-21swapper/320:41:133
42653599141,8cyclictest0-21swapper/323:16:133
42653499149,2cyclictest171rcu_preempt23:36:122
42653499148,3cyclictest530850-21latency_hist00:01:122
42653499142,8cyclictest432497-21latency_hist21:06:132
42653499142,10cyclictest536058-21grep00:11:122
42653499142,10cyclictest501083-21true23:11:132
426534991410,2cyclictest427300-21idleruntime-cro19:26:122
42653399143,8cyclictest426496-21munin-run19:11:131
42653399141,8cyclictest484248-21cat22:41:131
426533991410,3cyclictest579-21dbus-daemon00:01:131
42653299146,3cyclictest431362-21latency_hist20:46:120
42653299145,5cyclictest466195-21ssh22:09:000
42653299141,8cyclictest0-21swapper/023:38:200
42653299140,9cyclictest0-21swapper/000:11:130
112299140,2rtkit-daemon1121-21rtkit-daemon21:23:032
42653499139,3cyclictest1003-21mta-sts-daemon22:08:242
42653399137,1cyclictest0-21swapper/123:17:231
42653399136,6cyclictest613-21gpm22:23:021
42653399132,5cyclictest427546-21idleruntime-cro19:31:131
42653399132,5cyclictest427546-21idleruntime-cro19:31:131
42653399131,9cyclictest541165-21munin-run00:21:121
42653399131,9cyclictest490126-21latency_hist22:51:121
426533991310,2cyclictest428308-21munin-plugin-st19:46:131
426533991310,2cyclictest1002-21mta-sts-daemon23:43:451
42653299135,3cyclictest447564-21latency_hist21:36:130
42653299133,6cyclictest427545-21cut19:31:130
42653299133,6cyclictest427545-21cut19:31:130
42653299131,8cyclictest0-21swapper/023:10:040
42653299131,8cyclictest0-21swapper/021:39:380
42653299131,8cyclictest0-21swapper/021:28:160
42653299131,8cyclictest0-21swapper/021:21:550
42653299131,8cyclictest0-21swapper/021:18:510
42653299131,8cyclictest0-21swapper/000:17:170
42653299131,4cyclictest11050irq/107-eth%d00:21:280
42653299130,8cyclictest546557-21ssh00:34:340
112299130,1rtkit-daemon1000-21mta-sts-daemon19:52:430
112299130,1rtkit-daemon0-21swapper/121:18:321
112299130,1rtkit-daemon0-21swapper/120:08:281
42653599122,8cyclictest0-21swapper/300:01:133
42653599122,5cyclictest0-21swapper/323:46:143
42653599122,5cyclictest0-21swapper/323:21:133
42653599120,5cyclictest0-21swapper/322:31:183
42653499129,2cyclictest0-21swapper/223:28:002
42653499125,6cyclictest613-21gpm22:17:252
42653499123,8cyclictest432629-21diskmemload22:31:132
426534991210,2cyclictest1000-21mta-sts-daemon23:53:532
426534991210,0cyclictest341rcuc/220:36:132
42653399129,1cyclictest0-21swapper/119:51:121
42653399128,3cyclictest1003-21mta-sts-daemon22:32:461
42653399127,2cyclictest499002-21ssh23:07:071
42653399122,6cyclictest515979-21ssh23:36:121
42653399121,8cyclictest545429-21wc00:31:131
42653399121,2cyclictest472733-21ls22:21:131
42653399121,2cyclictest0-21swapper/121:11:121
426533991210,1cyclictest1000-21mta-sts-daemon22:06:541
42653299122,8cyclictest432241-21cat21:01:130
42653299122,8cyclictest431227-21cat20:41:130
42653299122,8cyclictest431227-21cat20:41:130
42653299121,7cyclictest0-21swapper/022:01:050
42653299121,7cyclictest0-21swapper/021:14:010
42653299121,7cyclictest0-21swapper/000:37:250
42653299120,1cyclictest191rcuc/020:01:120
42653599113,4cyclictest0-21swapper/322:14:123
42653599112,6cyclictest0-21swapper/319:41:123
42653599111,6cyclictest0-21swapper/300:35:373
42653599111,5cyclictest0-21swapper/300:21:073
42653499118,2cyclictest0-21swapper/222:06:122
42653499118,2cyclictest0-21swapper/221:36:132
42653499117,3cyclictest613-21gpm00:27:472
42653499116,4cyclictest613-21gpm00:20:552
42653499113,6cyclictest0-21swapper/219:11:132
42653499112,8cyclictest498289-21munin-run23:06:132
42653499112,6cyclictest587-21mta-sts-daemon22:25:312
42653499111,9cyclictest543309-21cut00:26:132
42653499111,5cyclictest426880-21grep19:16:132
42653499111,4cyclictest171rcu_preempt19:56:132
42653499111,2cyclictest171rcu_preempt21:46:122
42653499110,9cyclictest431863-21munin-plugin-st20:56:132
42653399119,1cyclictest1000-21mta-sts-daemon23:38:221
42653399118,2cyclictest441518-21unin-run21:26:131
42653399118,2cyclictest0-21swapper/123:56:131
42653399117,3cyclictest1121-21rtkit-daemon21:31:301
42653399117,3cyclictest1002-21mta-sts-daemon22:11:391
42653399116,4cyclictest697-21in:imuxsock19:56:131
42653399116,2cyclictest11050irq/107-eth%d21:52:561
42653399113,6cyclictest492833-21/usr/sbin/munin22:56:131
42653399112,6cyclictest431228-21latency_hist20:41:131
42653399112,6cyclictest431228-21latency_hist20:41:131
42653399112,5cyclictest428210-21latency_hist19:41:131
42653399110,11cyclictest1121-21rtkit-daemon20:49:011
42653299112,7cyclictest430356-21munin-plugin-st20:26:120
42653299111,6cyclictest430094-21munin-plugin-st20:21:130
42653299111,6cyclictest0-21swapper/019:45:370
112299110,6rtkit-daemon1000-21mta-sts-daemon21:39:381
112299110,1rtkit-daemon0-21swapper/019:06:380
42653599105,3cyclictest0-21swapper/300:21:133
42653599103,4cyclictest0-21swapper/300:26:363
42653599103,3cyclictest0-21swapper/322:51:243
42653599102,5cyclictest0-21swapper/322:10:213
42653599102,5cyclictest0-21swapper/320:26:123
42653599102,4cyclictest0-21swapper/322:42:363
42653599102,4cyclictest0-21swapper/321:25:353
42653599102,3cyclictest0-21swapper/320:01:123
42653599101,6cyclictest0-21swapper/300:11:153
42653599101,5cyclictest0-21swapper/323:36:123
42653499109,1cyclictest1001-21mta-sts-daemon23:21:512
42653499108,1cyclictest1003-21mta-sts-daemon22:48:102
42653499106,3cyclictest1003-21mta-sts-daemon00:04:212
42653499105,3cyclictest46905950ssh22:14:192
42653499105,2cyclictest503337-21ssh23:15:082
42653499104,4cyclictest429829-21munin-run20:16:122
42653499104,3cyclictest490831-21ssh22:52:272
42653499103,2cyclictest171rcu_preempt20:01:122
42653499102,6cyclictest430090-21systemctl20:21:132
42653499102,6cyclictest429480-21grep20:06:132
42653499102,5cyclictest430463-21latency_hist20:26:132
42653499101,6cyclictest428420-21latency_hist19:46:132
42653499101,5cyclictest521927-21latency_hist23:46:132
42653499100,9cyclictest3886975-21snmpd00:15:462
42653499100,7cyclictest487065-21munin-run22:46:132
42653499100,3cyclictest171rcu_preempt19:51:132
42653399107,2cyclictest435500-21cron21:16:131
42653399107,2cyclictest429816-21cron20:16:121
42653399107,2cyclictest11050irq/107-eth%d00:33:191
42653399102,5cyclictest549124-21idleruntime-cro00:41:131
42653399101,6cyclictest543495-21cat00:26:131
42653399101,6cyclictest453425-21cat21:46:131
42653399101,3cyclictest429082-21idleruntime-cro20:01:121
42653299107,2cyclictest0-21swapper/019:24:180
42653299105,2cyclictest427113-21latency_hist19:21:130
42653299102,6cyclictest432459-21latency_hist21:06:130
42653299101,8cyclictest431683-21latency_hist20:51:130
42653299101,7cyclictest428247-21cat19:41:130
112299100,6rtkit-daemon1003-21mta-sts-daemon23:37:222
112299100,1rtkit-daemon0-21swapper/020:02:490
4265359992,4cyclictest0-21swapper/322:59:513
4265359992,4cyclictest0-21swapper/322:20:213
4265359992,3cyclictest0-21swapper/322:21:163
4265359992,3cyclictest0-21swapper/300:41:133
4265359991,4cyclictest0-21swapper/320:29:183
4265359991,3cyclictest0-21swapper/319:26:123
4265359990,6cyclictest0-21swapper/323:43:533
4265349995,3cyclictest989-21lldpd20:43:252
4265349995,3cyclictest456729-21ssh21:51:482
4265349995,3cyclictest454379-21rm21:47:412
4265349995,3cyclictest446410-21kworker/u8:0+rpciod21:56:222
4265349995,3cyclictest436076-21ssh21:16:532
4265349994,3cyclictest0-21swapper/219:21:132
4265349992,5cyclictest431617-21munin-run20:51:122
4265349992,5cyclictest427940-21grep19:36:122
4265349991,5cyclictest431149-21latency_hist20:41:132
4265349991,5cyclictest431149-21latency_hist20:41:132
4265349990,2cyclictest171rcu_preempt19:31:132
4265349990,2cyclictest171rcu_preempt19:31:132
4265339997,1cyclictest1003-21mta-sts-daemon23:01:261
4265339995,3cyclictest989-21lldpd19:16:531
4265339995,3cyclictest459346-21ssh21:56:371
4265339995,3cyclictest453628-21ssh21:46:191
4265339995,3cyclictest441816-21ssh21:26:231
4265339995,3cyclictest427772-21sshd19:33:171
4265339995,3cyclictest427280-21sshd19:24:181
4265339992,5cyclictest430092-21basename20:21:131
4265329992,5cyclictest428628-21latency_hist19:51:130
4265329991,6cyclictest426775-21idleruntime-cro19:16:120
11229990,2rtkit-daemon0-21swapper/221:11:242
11229990,1rtkit-daemon0-21swapper/221:26:162
11229990,1rtkit-daemon0-21swapper/020:31:220
4265359982,3cyclictest0-21swapper/323:52:313
4265359982,3cyclictest0-21swapper/323:06:363
4265359981,5cyclictest0-21swapper/323:26:183
4265359981,5cyclictest0-21swapper/322:30:573
4265359981,5cyclictest0-21swapper/321:38:143
4265359981,5cyclictest0-21swapper/321:26:323
4265359981,4cyclictest0-21swapper/300:06:163
4265359981,3cyclictest0-21swapper/319:46:133
4265359980,5cyclictest0-21swapper/323:02:203
4265349986,1cyclictest0-21swapper/220:11:122
4265349982,5cyclictest432119-21run-parts21:01:122
4265349982,4cyclictest341rcuc/221:11:122
4265339985,2cyclictest3886975-21snmpd20:41:251
4265339984,3cyclictest3886975-21snmpd20:03:231
4265339982,4cyclictest431028-21latency_hist20:36:131
4265339981,6cyclictest430574-21latency_hist20:26:131
4265339981,4cyclictest432118-21idleruntime-cro21:01:121
4265339981,2cyclictest0-21swapper/120:26:131
4265339980,7cyclictest431955-21latency_hist20:56:131
4265329981,6cyclictest3886975-21snmpd20:10:180
4265329981,5cyclictest430671-21cat20:31:130
4265329980,3cyclictest429837-21idleruntime-cro20:16:120
4265359973,3cyclictest0-21swapper/322:37:163
4265359972,3cyclictest0-21swapper/321:56:193
4265359972,3cyclictest0-21swapper/321:19:033
4265359972,3cyclictest0-21swapper/320:16:133
4265359972,2cyclictest0-21swapper/322:46:213
4265359972,2cyclictest0-21swapper/322:01:143
4265359972,2cyclictest0-21swapper/321:51:173
4265359972,2cyclictest0-21swapper/320:21:133
4265359971,4cyclictest0-21swapper/321:36:133
4265359971,3cyclictest0-21swapper/321:46:193
4265359970,3cyclictest0-21swapper/323:56:163
4265349971,4cyclictest430711-21latency_hist20:31:132
4265339972,4cyclictest426774-21cut19:16:121
4265339970,6cyclictest432419-21latency_hist21:06:131
4265359964,1cyclictest0-21swapper/319:31:133
4265359964,1cyclictest0-21swapper/319:31:133
4265359962,3cyclictest0-21swapper/321:13:183
4265359962,2cyclictest0-21swapper/320:56:133
4265359961,4cyclictest0-21swapper/321:06:133
4265359961,4cyclictest0-21swapper/319:21:133
4265359961,3cyclictest0-21swapper/321:41:143
4265359961,3cyclictest0-21swapper/321:11:123
4265359961,3cyclictest0-21swapper/319:55:173
4265359960,3cyclictest0-21swapper/319:16:123
4265359953,2cyclictest0-21swapper/321:01:123
4265359952,3cyclictest0-21swapper/320:46:123
4265359952,2cyclictest0-21swapper/320:36:123
4265359951,3cyclictest0-21swapper/320:47:173
4265359951,2cyclictest0-21swapper/320:07:183
4265359951,2cyclictest0-21swapper/319:51:133
4265359942,2cyclictest0-21swapper/319:33:173
4265359941,2cyclictest0-21swapper/320:04:183
4265359941,2cyclictest0-21swapper/319:11:133
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional