You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-21 - 14:12
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot7.osadl.org (updated Thu May 21, 2026 00:44:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1479121358,93sleep114881-21unixbench_singl18:56:281
1479121358,93sleep114881-21unixbench_singl18:56:281
153919910889,13cyclictest20973-21latency_hist19:15:472
153859910511,79cyclictest15876-21apt-get22:36:030
15391999662,30cyclictest15372-21cyclictest22:10:232
15391999662,30cyclictest15372-21cyclictest22:10:232
15391999551,35cyclictest0-21swapper/221:51:192
15391999452,35cyclictest2374-21systemd-journal19:04:372
15389999458,30cyclictest1-21systemd21:50:461
1538999942,42cyclictest22262-21sh23:40:561
1538999942,42cyclictest22262-21sh23:40:561
1522429414,55sleep215261-21idleruntime-cro19:00:452
1522429414,55sleep215261-21idleruntime-cro19:00:452
1539199932,62cyclictest19426-21sh00:30:442
15389999370,15cyclictest13716-21kworker/u19:0-rpciod00:25:481
1538999933,43cyclictest10287-21/usr/sbin/munin22:26:171
1538999933,43cyclictest10287-21/usr/sbin/munin22:26:171
15391999270,16cyclictest9521-21sh21:31:072
15389999251,35cyclictest29125-21latency_hist19:40:491
15391999149,36cyclictest22549-21fschecks_time23:41:082
15391999149,36cyclictest22549-21fschecks_time23:41:082
15391999147,38cyclictest277-21dbus-daemon20:25:462
1539199914,49cyclictest29483-21apt21:10:452
1539199914,49cyclictest29483-21apt21:10:452
15389999149,35cyclictest0-21swapper/120:01:101
15385999061,19cyclictest18592-21latency_hist20:45:470
1539199893,38cyclictest32612-21grep21:15:472
15389998960,19cyclictest9169-21kworker/u18:3+nfsiod00:16:011
1538999892,28cyclictest23499-21diskmemload00:29:211
1539199883,40cyclictest22169-21latency_hist23:40:482
15389998864,14cyclictest24198-21kworker/u17:0-xprtiod23:46:021
15389998864,14cyclictest24198-21kworker/u17:0-xprtiod23:46:021
1538999883,40cyclictest19084-21fschecks_time22:41:061
15385998858,20cyclictest22079-21sh23:40:480
15385998819,43cyclictest0-21swapper/023:16:040
1539199876,33cyclictest8244-21unixbench_singl23:16:222
1539199875,36cyclictest25877-21modprobe19:30:452
1539199874,40cyclictest352-21runrttasks19:08:372
1539199874,40cyclictest352-21runrttasks19:08:372
1539199874,36cyclictest15226-21/usr/sbin/munin21:41:142
1539199873,40cyclictest17119-21/usr/sbin/munin22:36:502
1539199873,39cyclictest27526-21apt-key22:55:472
1539199873,39cyclictest27526-21apt-key22:55:472
1539199873,38cyclictest12700-21mailstats20:27:112
15389998767,14cyclictest2142-21threads23:06:221
15389998750,31cyclictest23499-21diskmemload22:31:191
15389998748,33cyclictest28608-21sh21:08:211
15389998748,33cyclictest28608-21sh21:08:211
1538999873,42cyclictest9334-21/usr/sbin/munin21:31:011
1539199864,41cyclictest13505-21latency_hist00:20:472
1539199864,39cyclictest29241-21apt-key19:40:472
1539199864,38cyclictest4366-21idleruntime-cro00:05:442
1539199864,38cyclictest14175-21grep23:26:222
1539199863,36cyclictest1674-21grep22:11:212
15389998666,13cyclictest10569-21unin-run00:15:451
15389998666,13cyclictest0-21swapper/120:25:471
1538999863,41cyclictest18744-21latency_hist23:35:471
1538599867,63cyclictest16888-21cron19:06:150
1538599867,63cyclictest16888-21cron19:06:150
15391998570,9cyclictest32625-21runrttasks19:50:462
1539199854,36cyclictest1392-21sh21:16:212
1539199854,36cyclictest1392-21sh21:16:212
1539199854,33cyclictest30227-21proc_pri19:41:342
1539199853,40cyclictest5498-21fschecks_time20:06:072
1539199853,40cyclictest13687-21cstates20:31:052
1539199853,37cyclictest21771-21cut19:17:042
1539199853,37cyclictest18794-21/usr/sbin/munin22:41:172
1539199853,36cyclictest28427-21ssh23:51:062
1539199853,34cyclictest17675-21mailstats20:41:162
1539199852,40cyclictest13790-21rm00:20:542
15389998570,10cyclictest15372-21cyclictest21:55:481
1538999854,7cyclictest0-21swapper/120:11:011
15389998545,33cyclictest0-21swapper/121:57:401
15389998545,33cyclictest0-21swapper/119:05:541
15389998545,33cyclictest0-21swapper/119:05:541
1538999853,7cyclictest0-21swapper/119:51:011
1538999853,7cyclictest0-21swapper/119:51:011
15385998558,19cyclictest26615-21latency_hist21:05:480
15385998558,19cyclictest26615-21latency_hist21:05:480
1538599853,57cyclictest4936-21modprobe00:06:020
1538599853,57cyclictest4936-21modprobe00:06:020
15391998467,10cyclictest0-21swapper/223:21:242
1539199844,35cyclictest6643-21/usr/sbin/munin22:21:122
1539199844,35cyclictest27891-21modprobe23:50:442
1539199844,35cyclictest27891-21modprobe23:50:442
1539199844,35cyclictest22444-21idleruntime20:56:082
1539199843,37cyclictest13336-21unixbench_singl21:36:222
1539199843,34cyclictest19042-21latency_hist23:35:482
1539199842,36cyclictest23806-21/usr/sbin/munin21:01:112
1539199842,36cyclictest23806-21/usr/sbin/munin21:01:112
15389998447,31cyclictest0-21swapper/121:20:481
15389998447,31cyclictest0-21swapper/121:20:481
1538999844,35cyclictest4398-21ssh23:11:021
1538999843,7cyclictest0-21swapper/120:31:001
1538999843,38cyclictest27562-21/usr/sbin/munin22:01:081
1538999843,35cyclictest32164-21/usr/sbin/munin19:46:221
1538999842,38cyclictest1472-21latency_hist00:00:471
1539199835,37cyclictest24797-21ssh21:56:142
1539199834,39cyclictest26389-21fschecks_count19:31:072
1539199834,35cyclictest27205-21ssh22:00:592
1539199833,38cyclictest22059-21latency_hist20:55:482
1539199833,37cyclictest8971-21netstat20:16:122
1539199833,36cyclictest19591-21sendmail_mailqu20:47:132
1539199832,37cyclictest12552-21cat22:30:482
1539199832,37cyclictest12552-21cat22:30:482
1538999834,31cyclictest19991-21/usr/sbin/munin23:36:421
15389998342,33cyclictest0-21swapper/119:26:221
1538999833,7cyclictest0-21swapper/119:31:011
1538999833,34cyclictest7555-21idleruntime-cro00:10:441
1538999833,34cyclictest7555-21idleruntime-cro00:10:441
1538999833,33cyclictest16545-21/usr/sbin/munin22:36:401
1538999832,38cyclictest517-21latency_hist22:10:481
1538999832,38cyclictest517-21latency_hist22:10:481
1539199825,35cyclictest4200-21/usr/sbin/munin23:11:142
1539199824,34cyclictest586-21fschecks_count19:51:072
1539199824,34cyclictest586-21fschecks_count19:51:072
1539199824,32cyclictest6533-21fschecks_count21:26:062
1539199823,39cyclictest10482-21ssh00:15:382
1539199823,37cyclictest797-21ssh23:59:072
1539199823,37cyclictest31567-21ssh23:01:192
1539199823,37cyclictest27942-21apt-get22:55:572
1539199823,37cyclictest20931-21grep21:50:452
1539199823,36cyclictest1410-21cstates23:06:042
1539199823,34cyclictest2450-21cat19:56:132
1539199823,31cyclictest22914-21/usr/sbin/munin19:21:032
1539199823,31cyclictest22914-21/usr/sbin/munin19:21:032
1539199822,37cyclictest4178-21ntp_states20:01:162
15389998259,15cyclictest21103-21apt-key19:15:491
15389998242,31cyclictest0-21swapper/120:56:011
1538999823,9cyclictest0-21swapper/123:50:571
1538999823,38cyclictest25355-21/usr/sbin/munin22:51:141
1538999823,38cyclictest25355-21/usr/sbin/munin22:51:141
1538999822,40cyclictest15562-21taskset19:00:551
1538999822,35cyclictest27407-21apt-get22:55:591
1538999822,34cyclictest7213-21/usr/sbin/munin22:21:121
15385998239,10cyclictest0-21swapper/022:12:430
1539199813,33cyclictest3285-21/usr/sbin/munin21:21:112
1539199813,24cyclictest15756-21tune2fs20:36:512
1539199813,24cyclictest15756-21tune2fs20:36:512
15389998159,12cyclictest0-21swapper/120:50:491
15389998142,32cyclictest0-21swapper/123:16:061
15389998139,34cyclictest0-21swapper/120:10:461
1538999813,37cyclictest352-21runrttasks21:24:041
1538999813,33cyclictest4698-21/usr/sbin/munin22:16:231
1538999813,33cyclictest4698-21/usr/sbin/munin22:16:231
1538999813,33cyclictest31010-21/usr/sbin/munin23:01:051
1538999813,31cyclictest18474-21apt-key20:45:461
1538999812,51cyclictest29624-21apt-get19:41:131
1538999812,34cyclictest1111-21/usr/sbin/munin22:11:091
1538999812,33cyclictest24082-21diskmemload22:49:491
1538999812,32cyclictest16055-21/usr/sbin/munin20:37:001
1538999812,32cyclictest16055-21/usr/sbin/munin20:37:001
1538599818,28cyclictest27942-21apt-get22:56:000
15391998062,13cyclictest4397-21processes22:16:192
15391998062,13cyclictest4397-21processes22:16:192
1539199804,32cyclictest21748-21/usr/sbin/munin22:46:192
15391998033,39cyclictest0-21swapper/200:06:392
15391998033,39cyclictest0-21swapper/200:06:392
1538999803,37cyclictest10162-21sh23:20:591
1538999803,35cyclictest11449-21apt-get20:26:001
1538999803,32cyclictest2581-21/usr/sbin/munin19:56:191
1538999802,34cyclictest23827-21apt-get21:01:021
1538999802,34cyclictest23827-21apt-get21:01:021
15385998048,23cyclictest9828-21sh22:26:030
15385998048,23cyclictest9828-21sh22:26:030
1539199793,33cyclictest12959-21fschecks_time22:31:072
1539199792,39cyclictest19676-21snmpd20:11:002
1538999793,35cyclictest20590-21/usr/sbin/munin20:51:021
1538999793,32cyclictest2063-21/usr/sbin/munin00:01:071
1538999793,31cyclictest9070-21/usr/sbin/munin20:16:161
1538999793,31cyclictest21562-21/usr/sbin/munin19:16:591
1538999793,30cyclictest13466-21rm23:26:081
1538999792,33cyclictest6498-21ssh21:26:061
15385997955,15cyclictest15355-21sh21:41:020
1538999784,8cyclictest0-21swapper/121:35:571
1538999783,31cyclictest29826-21ssh21:10:581
1538999782,32cyclictest15471-21/usr/sbin/munin21:41:061
1538999773,28cyclictest23674-21cat19:21:181
1538999773,28cyclictest23674-21cat19:21:181
15385997758,8cyclictest0-21swapper/021:31:110
15385997755,16cyclictest7031-21latency_hist23:15:480
1538599772,35cyclictest9021-21unin-run21:30:460
1538599763,57cyclictest18894-21apt-get20:45:590
1538599763,38cyclictest352-21runrttasks23:54:120
1538599763,30cyclictest27902-40ogrotate23:50:440
1538599763,30cyclictest27902-40ogrotate23:50:440
15385997555,13cyclictest8393-21latency_hist20:15:480
15385997458,11cyclictest15372-21cyclictest00:16:210
15385997351,14cyclictest0-21swapper/022:21:000
15385997344,19cyclictest24624-21latency_hist22:50:480
15385997340,24cyclictest0-21swapper/022:01:070
1538599733,44cyclictest16761-21/usr/sbin/munin00:26:170
1538599733,36cyclictest8185-21fschecks_time00:11:060
15385997321,24cyclictest23499-21diskmemload21:36:240
1538599726,42cyclictest181rcu_preempt23:41:120
1538599726,42cyclictest181rcu_preempt23:41:120
15385997258,9cyclictest15372-21cyclictest21:52:130
15385997245,19cyclictest2907-21sh21:20:310
15385997245,19cyclictest2907-21sh21:20:310
15385997212,25cyclictest19999-21rm22:41:350
15385997149,16cyclictest23506-21idleruntime-cro21:00:440
1538599714,55cyclictest31501-21cut23:56:080
15385997141,20cyclictest13527-21latency_hist20:30:500
1538599713,36cyclictest32586-21munin-run19:50:450
15385997133,28cyclictest0-21swapper/020:25:490
1538599712,39cyclictest30971-21idleruntime-cro19:45:450
1538599712,34cyclictest6356-21modprobe22:20:450
1538599712,34cyclictest6356-21modprobe22:20:450
15385997116,39cyclictest32611-21latency_hist21:15:470
1539799703,55cyclictest14634-21taskset23:27:373
1539799703,28cyclictest17839-21chrt19:06:003
1539799703,28cyclictest17839-21chrt19:06:003
1538599708,25cyclictest26128-21sh21:58:410
15385997052,13cyclictest6748-21latency_hist20:10:480
1538599703,36cyclictest12639-21/usr/sbin/munin22:31:110
1539799692,54cyclictest1518-21chrt23:06:083
1539799692,36cyclictest12146-21taskset00:16:553
1539799692,35cyclictest11983-21chrt20:26:163
1538599699,39cyclictest15438-21apt-get20:36:000
1538599699,39cyclictest15438-21apt-get20:36:000
15385996952,9cyclictest0-21swapper/019:21:050
15385996952,9cyclictest0-21swapper/019:21:050
15385996948,15cyclictest297-21systemd-logind23:25:460
15385996920,11cyclictest0-21swapper/021:05:570
15385996920,11cyclictest0-21swapper/021:05:570
140112699,35sleep014047-21df18:56:020
140112699,35sleep014047-21df18:56:020
1539799683,52cyclictest10210-21chrt22:26:133
1539799683,52cyclictest10210-21chrt22:26:133
1539799683,33cyclictest25110-21chrt22:51:083
1539799683,33cyclictest25110-21chrt22:51:083
1538599684,44cyclictest14516-21tail20:31:290
1538599683,38cyclictest18744-21latency_hist23:35:470
1538599683,33cyclictest14142-21grep00:21:070
1539799673,33cyclictest24243-21chrt21:56:003
1539799673,32cyclictest21323-21taskset19:15:563
1539799672,33cyclictest16846-21chrt23:31:183
1539799672,33cyclictest11352-21chrt23:21:413
15385996744,15cyclictest3369-21ssh21:21:030
1539799663,32cyclictest28870-21chrt22:03:023
1539799663,32cyclictest19222-21taskset00:30:133
1539799663,31cyclictest16020-21chrt20:36:573
1539799663,31cyclictest16020-21chrt20:36:573
1539799663,30cyclictest20079-21chrt22:41:483
1539799663,30cyclictest15649-21chrt00:23:283
1539799662,35cyclictest17074-21taskset21:43:243
1539799662,34cyclictest23734-21chrt19:21:193
1539799662,34cyclictest23734-21chrt19:21:193
1539799662,32cyclictest4330-21chrt00:05:443
15385996644,15cyclictest26067-21latency_hist19:30:480
15385996640,22cyclictest15372-21cyclictest21:50:470
1538599663,43cyclictest29522-21apt-key19:40:490
1538599663,34cyclictest32472-21runrttasks23:02:590
1539799654,30cyclictest2415-21taskset21:19:073
1539799654,30cyclictest2415-21taskset21:19:073
1539799653,32cyclictest5188-21chrt00:06:453
1539799653,32cyclictest5188-21chrt00:06:453
1539799653,32cyclictest2030-21chrt19:55:583
1539799653,31cyclictest14332-21taskset22:32:583
1539799653,30cyclictest7889-21chrt00:10:553
1539799653,30cyclictest24343-21taskset23:44:113
1539799653,30cyclictest24343-21taskset23:44:113
1539799652,35cyclictest11996-21chrt21:35:463
1539799652,33cyclictest28570-21chrt22:57:293
1539799652,33cyclictest19091-21chrt21:46:203
1539799652,32cyclictest7443-21chrt21:26:293
1539799652,32cyclictest27138-21chrt23:48:413
1539799652,32cyclictest27138-21chrt23:48:413
1539799652,32cyclictest14253-21chrt20:31:263
1539799652,31cyclictest15901-21chrt19:01:063
1539799652,30cyclictest8879-21chrt23:18:043
15385996549,8cyclictest31543-21rm22:07:110
15385996549,8cyclictest31543-21rm22:07:110
15385996545,15cyclictest24998-21sh22:51:070
15385996545,15cyclictest24998-21sh22:51:070
1538599654,41cyclictest1667-21/usr/sbin/munin00:01:170
1538599653,40cyclictest513-21cstates19:51:030
1538599653,40cyclictest513-21cstates19:51:030
1538599653,33cyclictest3899-21munin-run23:10:440
1538599653,29cyclictest20457-21/usr/sbin/munin20:51:230
1538599652,46cyclictest4985-21idleruntime-cro20:05:450
1539799644,30cyclictest8779-21chrt20:16:073
1539799642,33cyclictest29948-21taskset23:53:073
1539799642,32cyclictest21199-21chrt23:38:403
1539799642,31cyclictest30878-21chrt23:01:023
1539799642,31cyclictest21065-21chrt20:51:153
1539799642,31cyclictest1797-21chrt19:55:463
1539799642,31cyclictest1797-21chrt19:55:463
1539799642,31cyclictest17219-21chrt22:37:063
1539799642,30cyclictest32728-21chrt23:57:373
1539799642,30cyclictest23855-21chrt22:49:103
1538599642,45cyclictest352-21runrttasks23:29:190
1539799633,31cyclictest4227-21taskset23:10:553
1539799633,30cyclictest7918-21chrt22:21:473
1539799633,30cyclictest32677-21chrt22:10:243
1539799633,30cyclictest32677-21chrt22:10:243
1539799633,29cyclictest31318-21taskset21:12:313
1539799632,31cyclictest29139-21chrt21:09:513
1539799632,31cyclictest29139-21chrt21:09:513
1539799632,31cyclictest20764-21chrt19:15:153
1539799632,21cyclictest19803-21chrt20:47:223
1538599633,44cyclictest20869-21systemd-run19:15:460
1538599633,40cyclictest27555-21latency_hist19:35:470
1538599633,37cyclictest21301-21/usr/sbin/munin19:17:060
1539799623,29cyclictest14819-21chrt21:40:283
1539799622,31cyclictest7740-21chrt20:11:213
1539799622,31cyclictest5039-21taskset22:17:053
1539799622,31cyclictest5039-21taskset22:17:053
1539799622,30cyclictest32513-21chrt19:50:073
1539799622,30cyclictest27274-21chrt19:32:493
1539799622,30cyclictest1874-21chrt22:11:333
1539799622,30cyclictest11243-21chrt20:23:163
1538599623,39cyclictest352-21runrttasks19:05:440
1539799613,29cyclictest23839-21taskset21:00:593
1539799613,29cyclictest23839-21taskset21:00:593
1539799613,28cyclictest30728-21chrt19:42:463
1539799612,28cyclictest3619-21chrt20:00:523
1538599614,42cyclictest2883-21timerwakeupswit19:56:230
15385996118,19cyclictest8557-21awk20:16:010
1539799602,29cyclictest6571-21taskset20:10:363
1539799602,29cyclictest5943-21chrt21:25:403
1539799602,29cyclictest22159-21taskset20:56:013
1539799602,29cyclictest18070-21chrt20:41:433
1539799602,28cyclictest29014-21chrt19:39:343
1539799592,28cyclictest25717-21taskset19:28:483
1539799562,23cyclictest22557-21chrt21:51:593
152632509,23sleep30-21swapper/319:00:463
152632509,23sleep30-21swapper/319:00:463
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional