You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-10 - 17:17
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack5slot1.osadl.org (updated Thu Sep 10, 2026 12:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
297721030,1sleep483-21kcompactd010:41:004
9068991915,3cyclictest14879-21cron11:25:003
905899190,12cyclictest774-21runrttasks08:04:520
905899185,9cyclictest28066-21sh12:26:140
905899180,7cyclictest27162-21ssh10:00:200
905899180,14cyclictest21423-21sh12:05:020
905899180,10cyclictest9094-21sh10:26:190
905899180,10cyclictest6358-21sh11:20:010
905899180,10cyclictest413-21ssh11:52:540
905899180,10cyclictest16457-21sh11:07:010
905899180,10cyclictest16457-21sh11:07:010
9063991713,3cyclictest23738-21latency_hist11:30:001
905899173,10cyclictest14082-21sh12:36:470
905899170,9cyclictest9372-21sh11:03:190
905899170,9cyclictest9372-21sh11:03:190
905899170,9cyclictest774-21runrttasks11:56:460
905899170,9cyclictest774-21runrttasks08:43:510
905899170,9cyclictest26491-21sh11:12:500
905899170,9cyclictest16708-21sh10:49:310
905899170,9cyclictest13986-21ntp_kernel_err12:00:180
905899170,14cyclictest32643-21sh10:21:210
905899170,10cyclictest774-21runrttasks09:03:490
905899170,10cyclictest32123-21sh09:27:030
906699168,6cyclictest15006-21grep07:20:182
906399164,8cyclictest751-21postgres11:30:491
906399164,8cyclictest19799-21mailstats07:30:191
905899162,10cyclictest18230-21sh10:13:510
9058991611,4cyclictest711-21snmpd11:30:000
905899160,9cyclictest774-21runrttasks07:52:580
906899157,6cyclictest5023-21grep11:00:233
906899157,6cyclictest5023-21grep11:00:233
906899157,6cyclictest21928-21wc10:15:233
906899154,8cyclictest11941-21timerandwakeup12:35:253
906899151,10cyclictest16038-21runrttasks11:06:443
906899151,10cyclictest16038-21runrttasks11:06:443
906699158,5cyclictest14739-21grep09:35:172
906699154,8cyclictest9408-21cut07:10:112
906699154,8cyclictest711-21snmpd11:13:192
9066991511,3cyclictest9799-21idleruntime-cro08:19:592
906699151,10cyclictest9691-21/usr/sbin/munin11:40:132
906699151,10cyclictest3880-21/usr/sbin/munin09:30:012
906699151,10cyclictest14987-21ssh09:54:092
906699151,10cyclictest11987-21df07:15:132
906699150,10cyclictest26308-21/usr/sbin/munin08:55:112
906399154,8cyclictest19351-21mailstats10:50:201
906399151,10cyclictest26115-21ssh09:24:081
905899156,7cyclictest29405-21sh09:44:040
905899154,8cyclictest17748-21timerandwakeup12:20:230
9058991511,3cyclictest683-21dbus-daemon07:30:010
905899151,10cyclictest19789-21runrttasks09:56:120
905899151,10cyclictest19741-21grep07:30:180
905899150,9cyclictest103-1kworker/0:1H+kblockd07:37:400
905899150,8cyclictest23361-21runrttasks08:46:140
905899150,13cyclictest15470-21grep10:30:150
906999144,8cyclictest11646-21/usr/sbin/munin07:15:124
906999143,8cyclictest18308-21switchtime08:35:234
906999141,9cyclictest774-21runrttasks11:44:034
906999141,9cyclictest4416-21sh12:31:124
906999141,9cyclictest3279-21sh10:23:334
906999141,9cyclictest31887-21sh10:39:534
906999141,9cyclictest28340-21/usr/sbin/munin07:50:124
906999141,9cyclictest23112-21sh09:22:024
906999140,10cyclictest9647-21chrt11:58:084
906999140,10cyclictest774-21runrttasks11:16:074
906999140,10cyclictest774-21runrttasks11:12:284
906999140,10cyclictest774-21runrttasks10:45:064
906999140,10cyclictest774-21runrttasks10:10:004
906999140,10cyclictest774-21runrttasks09:52:494
906999140,10cyclictest7617-21ssh11:38:544
906999140,10cyclictest5170-21latency_hist08:10:004
906999140,10cyclictest29309-21ssh11:32:364
906999140,10cyclictest23660-21sh10:16:224
906999140,10cyclictest21544-21rm10:33:514
906999140,10cyclictest21486-21rm09:39:484
906999140,10cyclictest13764-21ssh12:36:334
906999140,10cyclictest12263-21/usr/sbin/munin11:05:124
906999140,10cyclictest12263-21/usr/sbin/munin11:05:114
906999140,10cyclictest10435-21sh10:09:404
906899146,7cyclictest1811-21apache207:30:543
906899145,8cyclictest21925-21/usr/sbin/munin07:35:173
906899143,8cyclictest751-21postgres09:50:463
906899142,7cyclictest50-21ksoftirqd/309:30:033
906899141,9cyclictest700-21gdbus10:35:003
906899141,9cyclictest4293-21sh12:31:063
906899141,9cyclictest27109-21runrttasks10:55:113
906899141,9cyclictest21343-21sh12:22:473
906899141,9cyclictest20027-21idleruntime08:40:163
906899141,9cyclictest17214-21sh12:02:113
9068991411,2cyclictest18267-21cron07:30:013
906899140,10cyclictest774-21runrttasks08:27:523
906899140,10cyclictest7188-21sh10:07:203
906899140,10cyclictest5780-21rm11:37:353
906899140,10cyclictest32608-21ssh11:34:573
906899140,10cyclictest29817-21mailstats09:00:203
906899140,10cyclictest28063-21sh09:43:063
906899140,10cyclictest26983-21diskmemload12:25:273
906899140,10cyclictest26307-21sh10:54:593
906899140,10cyclictest24660-21sh09:23:053
906899140,10cyclictest23725-21/usr/sbin/munin10:35:143
906899140,10cyclictest19594-21sh11:27:013
906899140,10cyclictest1889-21rm09:28:363
906899140,10cyclictest18798-21chrt08:37:063
906899140,10cyclictest16672-21sh11:44:023
906899140,10cyclictest16644-21ssh09:36:213
906899140,10cyclictest1562-21ssh11:16:493
906699147,5cyclictest21075-21sed10:15:152
906699145,8cyclictest24617-21/usr/sbin/munin11:30:162
906699144,8cyclictest11205-21/usr/sbin/munin08:20:182
906699141,9cyclictest3165-21/usr/sbin/munin08:05:242
906699141,9cyclictest28876-21ssh12:26:492
906699141,9cyclictest23728-21runrttasks11:47:432
906699141,9cyclictest17728-21rm12:39:272
906699141,9cyclictest1300-21ssh12:30:072
906699141,9cyclictest10877-21irqstats09:15:172
906699141,10cyclictest9632-21ssh11:03:302
906699141,10cyclictest9632-21ssh11:03:302
906699141,10cyclictest321-21systemd-journal09:45:182
906699140,9cyclictest20870-21/usr/sbin/munin07:35:102
906699140,10cyclictest9661-21sh11:21:152
906699140,10cyclictest5683-21ssh10:06:162
906699140,10cyclictest5246-21sh09:12:012
906699140,10cyclictest4447-21fschecks_count11:55:152
906699140,10cyclictest3222-21ssh10:41:102
906699140,10cyclictest31939-21needreboot12:10:172
906699140,10cyclictest31301-21diskstats09:05:132
906699140,10cyclictest30643-21/usr/sbin/munin07:55:242
906699140,10cyclictest30065-21/usr/sbin/munin11:15:152
906699140,10cyclictest29354-21/usr/sbin/munin10:20:122
906699140,10cyclictest29093-21irqstats07:50:172
906699140,10cyclictest28834-21sh09:43:392
906699140,10cyclictest27930-21sh10:00:362
906699140,10cyclictest26784-21ssh10:55:072
906699140,10cyclictest25285-21sh10:35:242
906699140,10cyclictest25265-21chrt07:42:492
906699140,10cyclictest24214-21sh12:05:522
906699140,10cyclictest23657-21/usr/sbin/munin08:50:002
906699140,10cyclictest22613-21ssh11:29:122
906699140,10cyclictest19939-21sh09:56:192
906699140,10cyclictest19626-21ntp_kernel_pll_07:30:182
906699140,10cyclictest19436-21sh12:03:482
906699140,10cyclictest16280-21sh10:30:232
906699140,10cyclictest16101-21/usr/sbin/munin12:20:162
906699140,10cyclictest12412-21/usr/sbin/munin08:25:122
906699140,10cyclictest11478-21sh10:45:442
906699140,10cyclictest11457-21/usr/sbin/munin10:10:192
906699140,10cyclictest11094-21ssh12:16:472
906399145,7cyclictest8521-21ssh11:20:261
906399141,9cyclictest774-21runrttasks12:20:071
906399141,9cyclictest412-21ssh11:16:011
906399141,9cyclictest27852-21/usr/sbin/munin09:25:221
906399141,9cyclictest22991-21runrttasks07:39:211
906399141,9cyclictest18382-21threads09:55:251
906399141,9cyclictest15206-21sh09:17:451
906399141,10cyclictest28175-21chrt08:58:201
906399141,10cyclictest2644-21runrttasks08:02:101
906399141,10cyclictest10884-21ssh10:09:581
906399140,11cyclictest9095-21sh10:26:181
906399140,10cyclictest9245-21cat07:10:021
906399140,10cyclictest9245-21cat07:10:011
906399140,10cyclictest7806-21/usr/sbin/munin09:50:111
906399140,10cyclictest7764-21runrttasks08:15:041
906399140,10cyclictest774-21runrttasks11:35:001
906399140,10cyclictest774-21runrttasks07:18:551
906399140,10cyclictest711-21snmpd09:40:071
906399140,10cyclictest711-21snmpd08:10:241
906399140,10cyclictest6208-21sh12:32:291
906399140,10cyclictest4633-21cut11:55:151
906399140,10cyclictest4217-21chrt09:30:021
906399140,10cyclictest3850-21ssh10:41:371
906399140,10cyclictest3702-21tr11:00:121
906399140,10cyclictest3702-21tr11:00:111
906399140,10cyclictest3406-21sh09:10:421
906399140,10cyclictest30810-21/usr/sbin/munin12:10:231
906399140,10cyclictest29354-21/usr/sbin/munin10:20:151
906399140,10cyclictest28186-21latency_hist07:49:591
906399140,10cyclictest27467-21/usr/sbin/munin11:50:241
906399140,10cyclictest26868-21/usr/sbin/munin10:55:181
906399140,10cyclictest26474-21ssh10:35:591
906399140,10cyclictest26283-21latency_hist08:55:001
906399140,10cyclictest25489-21ssh10:00:011
906399140,10cyclictest25012-21/usr/sbin/munin12:25:151
906399140,10cyclictest23584-21sh10:16:191
906399140,10cyclictest23372-21/usr/sbin/munin07:40:241
906399140,10cyclictest23365-21ssh11:10:361
906399140,10cyclictest18422-21sh11:45:051
906399140,10cyclictest18203-21ssh10:31:281
906399140,10cyclictest18012-21grep08:35:171
906399140,10cyclictest15149-21sh11:06:051
906399140,10cyclictest15149-21sh11:06:051
906399140,10cyclictest15081-21rm12:37:311
906399140,10cyclictest14942-21timerandwakeup09:35:211
906399140,10cyclictest14708-21sshd08:30:061
906399140,10cyclictest13968-21apt-get07:20:111
906399140,10cyclictest13733-21sh10:47:231
906399140,10cyclictest13604-21sh10:10:321
906399140,10cyclictest1344-21sh09:45:461
906399140,10cyclictest12449-21ssh12:17:461
906399140,10cyclictest12438-21ssh11:40:591
905899146,6cyclictest14443-21sh11:42:260
905899143,8cyclictest26955-21grep10:55:110
905899141,10cyclictest2519-21sh10:05:100
905899141,10cyclictest2087-21/usr/sbin/munin10:40:240
905899140,7cyclictest774-21runrttasks08:17:330
905899140,7cyclictest31499-21expr12:10:140
905899140,12cyclictest21292-21sh09:20:450
905899140,12cyclictest13504-21sort09:35:100
905899140,12cyclictest1160-21basename09:10:140
905899140,10cyclictest774-21runrttasks11:17:020
905899140,10cyclictest774-21runrttasks09:08:350
905899140,10cyclictest711-21snmpd08:34:140
905899140,10cyclictest711-21snmpd07:19:510
905899140,10cyclictest6825-21ssh12:32:560
905899140,10cyclictest4621-21sh11:36:450
905899140,10cyclictest4223-21ssh09:30:020
905899140,10cyclictest3155-21runrttasks08:05:040
905899140,10cyclictest27211-21find07:45:200
905899140,10cyclictest26646-21ssh11:30:400
905899140,10cyclictest23846-21ssh10:35:140
905899140,10cyclictest21739-21ssh11:46:180
905899140,10cyclictest20405-21ssh10:50:460
905899140,10cyclictest20119-21sh10:15:010
905899140,10cyclictest12561-21sh09:15:510
905899140,10cyclictest1170-21diskmemload09:45:390
905899140,10cyclictest11059-21sh12:16:460
905899140,10cyclictest10626-21rm09:51:010
906999135,6cyclictest321-21systemd-journal08:30:404
906999135,6cyclictest31488-21tune2fs09:05:154
906999131,9cyclictest864-21atemtest08:00:134
906999131,9cyclictest19694-21runrttasks11:27:054
906999131,9cyclictest17581-21sh12:02:284
906999131,9cyclictest10000-21sh09:15:114
906999130,9cyclictest9653-21chrt08:18:204
906999130,9cyclictest9509-21runrttasks12:15:374
906999130,9cyclictest6373-21runrttasks09:30:254
906999130,9cyclictest5831-21taskset08:10:144
906999130,9cyclictest5598-21ssh11:00:374
906999130,9cyclictest5598-21ssh11:00:374
906999130,9cyclictest4917-21ssh12:13:424
906999130,9cyclictest478-21diskmemload10:00:054
906999130,9cyclictest30643-21ssh12:28:074
906999130,9cyclictest27798-21ssh09:25:084
906999130,9cyclictest26868-21/usr/sbin/munin10:55:164
906999130,9cyclictest26308-21/usr/sbin/munin08:55:174
906999130,9cyclictest26266-21latency_hist08:55:014
906999130,9cyclictest25119-21sh09:40:594
906999130,9cyclictest22567-21missed_timers08:45:164
906999130,9cyclictest21575-21diskmemload12:05:084
906999130,9cyclictest20870-21/usr/sbin/munin07:35:224
906999130,9cyclictest20543-21sh11:45:264
906999130,9cyclictest20228-21runrttasks07:30:284
906999130,9cyclictest1740-21ssh09:46:044
906999130,9cyclictest17272-21fschecks_count09:55:154
906999130,9cyclictest1527-21df09:10:154
906999130,9cyclictest12852-21sh10:29:014
906999130,9cyclictest11284-21runrttasks07:14:264
906999130,9cyclictest10639-21sh11:21:574
906999130,9cyclictest10108-21/usr/sbin/munin08:20:114
906999130,10cyclictest711-21snmpd07:20:504
906999130,10cyclictest32414-21chrt07:57:004
906999130,10cyclictest29544-21sed09:00:184
906999130,10cyclictest28226-21hddtemp_smartct11:50:154
906999130,10cyclictest26432-21cut07:45:154
906999130,10cyclictest24127-21awk07:40:174
906999130,10cyclictest20314-21ssh10:50:434
906999130,10cyclictest16829-21fschecks_time07:25:124
906999130,10cyclictest16021-21ssh12:20:074
906999130,10cyclictest13580-21ps08:25:214
906899139,3cyclictest1118-21grep08:00:133
906899136,5cyclictest9051-21cyclictest07:18:023
906899135,6cyclictest27970-21cut11:50:143
906899131,9cyclictest25934-21apt-key07:45:013
906899131,9cyclictest25854-21runrttasks08:53:043
906899131,8cyclictest50-21ksoftirqd/310:20:023
906899130,9cyclictest9961-21latency_hist08:19:593
906899130,9cyclictest897-21sh09:10:033
906899130,9cyclictest774-21runrttasks08:10:163
906899130,9cyclictest774-21runrttasks08:06:483
906899130,9cyclictest5874-21rm10:25:113
906899130,9cyclictest3933-21/usr/sbin/munin11:55:123
906899130,9cyclictest31266-21/usr/sbin/munin09:45:183
906899130,9cyclictest30937-21/usr/sbin/munin09:05:193
906899130,9cyclictest29863-21grep07:50:233
906899130,9cyclictest28320-21munin-run09:00:003
906899130,9cyclictest27925-21sh10:00:353
906899130,9cyclictest23372-21/usr/sbin/munin07:40:183
906899130,9cyclictest21208-21/usr/sbin/munin11:10:213
906899130,9cyclictest15175-21sendmail_mailtr07:20:193
906899130,9cyclictest15097-21sort08:30:123
906899130,9cyclictest13415-21sh10:10:253
906899130,9cyclictest12187-21ssh09:15:363
906899130,9cyclictest10108-21/usr/sbin/munin08:20:193
906899130,8cyclictest50-21ksoftirqd/312:15:113
906899130,10cyclictest30419-21dpkg12:10:013
906899130,10cyclictest2857-21ssh10:40:533
906899130,10cyclictest22509-21cat08:45:163
906899130,10cyclictest21648-21/usr/sbin/munin12:05:123
906899130,10cyclictest18330-21ssh11:45:013
906899130,10cyclictest16539-21ssh09:55:033
906899130,10cyclictest10725-21timerandwakeup07:10:233
906899130,10cyclictest10099-21wc10:45:173
906699130,9cyclictest5849-21sh10:25:092
906699130,9cyclictest5469-21/usr/sbin/munin08:10:172
906699130,9cyclictest4360-21ssh09:30:102
906699130,9cyclictest28988-21sh09:00:142
906699130,9cyclictest2628-21runrttasks08:01:562
906699130,9cyclictest18862-21/usr/sbin/munin09:20:162
906699130,9cyclictest17941-21/usr/sbin/munin10:50:172
906699130,9cyclictest15408-21cat08:30:152
906699130,9cyclictest12111-21ssh11:05:042
906699130,9cyclictest12111-21ssh11:05:042
906699130,10cyclictest774-21runrttasks08:35:212
906699130,10cyclictest774-21runrttasks07:25:102
906699130,10cyclictest27467-21/usr/sbin/munin11:50:132
906699130,10cyclictest26159-21cpu07:45:122
906699130,10cyclictest25192-21awk08:50:212
906699130,10cyclictest1095-21cpuspeed_turbos11:35:122
906399131,9cyclictest30986-21cstates07:55:131
906399130,9cyclictest9699-21entropy07:10:141
906399130,9cyclictest774-21runrttasks12:00:081
906399130,9cyclictest3165-21/usr/sbin/munin08:05:191
906399130,9cyclictest30937-21/usr/sbin/munin09:05:221
906399130,9cyclictest28734-21fschecks_count07:50:141
906399130,9cyclictest22125-21sh12:05:151
906399130,9cyclictest22066-21fschecks_count08:45:131
906399130,9cyclictest19918-21fschecks_time08:40:151
906399130,9cyclictest16972-21/usr/sbin/munin07:25:151
906399130,9cyclictest12412-21/usr/sbin/munin08:25:111
906399130,10cyclictest774-21runrttasks09:01:021
906399130,10cyclictest10357-21cut08:20:121
905899134,8cyclictest10450-21/usr/sbin/munin08:20:120
905899131,9cyclictest13160-21interrupts08:25:170
905899130,9cyclictest6224-21irqstats08:10:160
905899130,9cyclictest24643-21gltestperf08:50:150
905899130,9cyclictest18070-21ntp_kernel_pll_08:35:170
905899130,9cyclictest10279-21cat07:10:170
905899130,7cyclictest103-1kworker/0:1H+kblockd07:56:450
905899130,7cyclictest103-1kworker/0:1H+kblockd07:40:350
905899130,10cyclictest774-21runrttasks08:55:150
905899130,10cyclictest15221-21python307:20:210
906999120,9cyclictest21078-21runrttasks08:41:284
906899120,9cyclictest30637-21runrttasks07:55:063
906699120,9cyclictest19346-21/usr/sbin/munin08:40:122
905899120,9cyclictest9023-21latency_hist07:10:020
905899120,9cyclictest9023-21latency_hist07:10:010
906999110,8cyclictest9142-21latency_hist07:10:024
906999110,8cyclictest9142-21latency_hist07:10:024
276722110,1sleep50-21swapper/512:25:575
76872100,1sleep50-21swapper/512:33:355
62402100,1sleep50-21swapper/511:01:065
62402100,1sleep50-21swapper/511:01:065
284092100,1sleep50-21swapper/509:43:225
90689990,7cyclictest9072-21basename07:10:023
90689990,7cyclictest9072-21basename07:10:023
90669990,7cyclictest9067-21date07:10:012
90669990,7cyclictest9067-21date07:10:002
32381290,0sleep50-21swapper/510:57:595
20333290,7sleep50-21swapper/510:32:595
11388290,0sleep50-21swapper/510:10:095
14212280,1sleep50-21swapper/508:27:255
4865270,0sleep50-21swapper/508:06:025
13525270,6sleep50-21swapper/507:18:375
16141262,2sleep50-21swapper/511:06:495
16141262,2sleep50-21swapper/511:06:485
1562260,1sleep50-21swapper/510:04:565
7131250,2sleep50-21swapper/512:15:075
6571250,1sleep50-21swapper/512:14:555
5614250,3sleep50-21swapper/510:06:135
3734250,1sleep50-21swapper/509:29:555
3547250,1sleep50-21swapper/509:47:225
31928250,1sleep50-21swapper/510:39:555
30326250,1sleep50-21swapper/507:54:545
30023251,2sleep50-21swapper/511:50:515
27606251,2sleep50-21swapper/512:08:185
17905250,1sleep50-21swapper/511:44:555
14670250,1sleep50-21swapper/511:24:525
7414241,1sleep50-21swapper/509:13:335
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional