You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-05 - 03:18
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Fri Jun 05, 2026 00:44:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
6487991103,65cyclictest15069-21ssh21:54:571
584621109,65sleep25914-21sed18:55:292
584621109,65sleep25914-21sed18:55:292
6495999717,23cyclictest6195-21sh23:28:052
107662970,7sleep214071-21diskmemload23:35:572
107662970,7sleep214071-21diskmemload23:35:572
648399952,61cyclictest18723-21apt-get22:55:010
648399952,61cyclictest18723-21apt-get22:55:010
62672946,16sleep10-21swapper/118:58:591
62672946,16sleep10-21swapper/118:58:591
6487999348,37cyclictest277-21dbus-daemon00:04:451
6487999348,37cyclictest277-21dbus-daemon00:04:451
648799933,33cyclictest10611-21unixbench_multi22:40:211
6487999252,35cyclictest6472-21cyclictest00:07:451
648799924,35cyclictest618-21/usr/sbin/munin22:25:171
6487999241,44cyclictest26196-21runrttasks23:06:371
648799923,32cyclictest22565-21tune2fs19:45:051
648799914,33cyclictest30586-21/usr/sbin/munin23:15:111
648799914,32cyclictest19075-21runrttasks22:01:031
648799913,35cyclictest30633-21fschecks_time20:10:051
649599908,64cyclictest18763-21ssh22:55:012
649599908,64cyclictest18763-21ssh22:55:012
648799904,35cyclictest3033-21fschecks_time20:25:061
648799904,35cyclictest29064-21latency_hist21:24:481
648799902,36cyclictest29629-21grep21:25:061
648799902,34cyclictest352-21runrttasks22:21:421
648799902,33cyclictest20477-21latency_hist19:39:471
648799894,35cyclictest8571-21tune2fs19:04:521
648799894,35cyclictest352-21runrttasks22:14:491
648799894,32cyclictest352-21runrttasks23:45:441
648799894,32cyclictest15086-21processes21:00:171
648799894,32cyclictest15086-21processes21:00:171
648799893,37cyclictest13662-21grep20:55:201
648799893,36cyclictest26904-21latency_hist19:59:491
648799893,35cyclictest16347-21awk19:26:141
648799893,32cyclictest8273-21latency_hist19:04:471
648799884,34cyclictest4784-21processes23:25:161
648799884,32cyclictest3883-21fschecks_count22:30:051
648799884,31cyclictest21945-21ssh23:00:051
648799884,31cyclictest10803-21latency_hist20:49:471
6487998839,42cyclictest0-21swapper/122:05:161
648799883,36cyclictest352-21runrttasks22:14:371
648799883,36cyclictest352-21runrttasks22:14:371
648799883,33cyclictest17369-21/usr/sbin/munin21:05:101
648799883,31cyclictest17460-21sshd19:15:071
648799883,31cyclictest17460-21sshd19:15:071
6487998831,44cyclictest0-21swapper/119:34:471
6487998831,44cyclictest0-21swapper/119:34:471
6487998828,50cyclictest11908-21apt-key21:49:481
6487998828,50cyclictest11908-21apt-key21:49:481
648799882,35cyclictest1416-21fschecks_time20:20:061
648799882,35cyclictest1416-21fschecks_time20:20:061
648799882,33cyclictest22531-21cut23:55:081
6483998864,16cyclictest17450-21fschecks_count19:30:060
6483998864,16cyclictest17450-21fschecks_count19:30:060
6495998758,21cyclictest29957-21latency_hist22:19:462
648799875,31cyclictest6206-21fschecks_count20:35:051
648799873,33cyclictest21550-21grep19:41:201
648799873,32cyclictest23404-21/usr/sbin/munin21:15:061
648799873,32cyclictest23404-21/usr/sbin/munin21:15:061
648799873,31cyclictest15309-21readlink19:24:461
6487998728,53cyclictest0-21swapper/120:50:501
6487998728,53cyclictest0-21swapper/120:50:501
6483998747,31cyclictest6472-21cyclictest21:19:480
6483998747,31cyclictest6472-21cyclictest21:19:480
648799864,33cyclictest12837-21fschecks_time22:45:071
648799864,32cyclictest8205-21proc_pri20:40:161
648799864,31cyclictest14909-21latency_hist21:54:471
648799864,30cyclictest32373-21/usr/sbin/munin21:30:081
648799864,30cyclictest28108-21unixbench_singl20:00:191
648799863,35cyclictest19657-21grep22:56:081
648799863,35cyclictest19657-21grep22:56:081
648799863,35cyclictest13271-21/usr/sbin/munin23:40:081
648799863,34cyclictest6589-21/usr/sbin/munin22:35:131
648799863,34cyclictest6589-21/usr/sbin/munin22:35:131
648799863,33cyclictest5894-21/usr/sbin/munin21:40:051
648799863,33cyclictest5270-21timerwakeupswit20:30:191
648799863,33cyclictest3401-21cat21:35:111
648799863,33cyclictest3401-21cat21:35:111
648799862,35cyclictest9554-21ssh23:34:081
648799862,35cyclictest9554-21ssh23:34:081
648799862,35cyclictest1582-21latency23:20:091
648799862,33cyclictest12043-21latency_hist19:14:471
6483998639,38cyclictest28497-21cron20:04:440
648799854,33cyclictest29008-21fschecks_time20:05:051
648799853,36cyclictest30301-21latency_hist23:14:461
648799853,36cyclictest30301-21latency_hist23:14:461
648799853,32cyclictest17460-21sshd00:10:031
648799853,32cyclictest17460-21sshd00:10:031
648799853,30cyclictest11439-21sendmail_mailqu23:36:251
648799853,30cyclictest11439-21sendmail_mailqu23:36:251
6487998525,9cyclictest0-21swapper/100:15:031
648799852,38cyclictest7449-21latency_hist00:24:471
6483998544,34cyclictest6264-21rm23:28:170
6495998465,9cyclictest0-21swapper/222:24:462
6495998417,26cyclictest11164-21runrttasks20:50:362
6495998417,26cyclictest11164-21runrttasks20:50:362
6495998412,27cyclictest8472-21munin-node19:04:492
648799844,28cyclictest19215-21/usr/sbin/munin23:50:041
648799843,33cyclictest32184-21fschecks_count20:15:051
648799843,32cyclictest352-21runrttasks22:52:091
648799843,32cyclictest352-21runrttasks22:52:091
648799843,30cyclictest20406-21/usr/sbin/munin21:09:561
648799842,32cyclictest24122-21cut19:50:061
6487998415,29cyclictest7677-21cat00:25:011
6487998415,29cyclictest7677-21cat00:25:011
6495998362,12cyclictest25981-21ssh23:06:002
648399833,30cyclictest26909-21kworker/u17:2+rpciod22:41:230
517828317,38sleep30-21swapper/318:55:103
517828317,38sleep30-21swapper/318:55:103
6483998244,28cyclictest17168-21grep21:04:470
6483998244,28cyclictest17168-21grep21:04:470
6483998239,36cyclictest0-21swapper/023:50:000
6483998158,16cyclictest30782-21sendmail00:09:430
6483998125,27cyclictest0-21swapper/019:20:110
6495998015,28cyclictest11783-21sh22:43:302
6483998049,22cyclictest3661-21grep20:25:200
6483998048,27cyclictest11085-21ntpd23:05:140
6483998027,26cyclictest0-21swapper/020:20:160
6483998027,26cyclictest0-21swapper/020:20:160
6495997961,13cyclictest28652-21latency_hist20:04:472
6495997958,13cyclictest18877-21cron23:49:442
6495997913,28cyclictest352-21runrttasks22:53:252
6495997913,28cyclictest352-21runrttasks22:53:252
6502997821,40cyclictest0-21swapper/320:50:323
6502997821,40cyclictest0-21swapper/320:50:323
6495997860,12cyclictest32021-21cpu20:15:002
6495997848,21cyclictest20371-21latency_hist19:39:462
6495997815,26cyclictest31294-21ssh21:27:392
6483997827,34cyclictest0-21swapper/021:44:290
649599772,36cyclictest20205-21apt-get19:39:582
648399762,44cyclictest20593-21dpkg19:39:480
6483997616,29cyclictest14071-21diskmemload22:30:070
6502997521,39cyclictest0-21swapper/319:29:443
6495997558,10cyclictest8748-21ssh21:44:472
6495997552,15cyclictest7587-21cpu00:25:012
6495997552,15cyclictest7587-21cpu00:25:012
6483997518,33cyclictest12270-21sh23:37:450
6483997518,33cyclictest12270-21sh23:37:450
650299744,46cyclictest0-21swapper/322:00:053
6495997456,12cyclictest297-21systemd-logind21:09:452
6483997457,10cyclictest5005-21kworker/u18:2+events_unbound19:09:460
6483997453,15cyclictest8948-21kworker/u18:2+events_unbound21:09:440
6483997433,30cyclictest821-21timerandwakeup21:30:200
6483997433,30cyclictest0-21swapper/023:59:470
648399742,31cyclictest21938-21fschecks_count23:00:050
6502997314,37cyclictest0-21swapper/323:35:093
6502997314,37cyclictest0-21swapper/323:35:093
6495997341,23cyclictest14543-21threads19:20:182
649599732,48cyclictest15134-21apt-get19:24:582
6495997313,27cyclictest352-21runrttasks22:32:402
6495997311,24cyclictest352-21runrttasks23:56:222
6483997357,11cyclictest6472-21cyclictest23:42:250
6483997338,28cyclictest7174-21cpu23:30:000
6483997338,28cyclictest7174-21cpu23:30:000
6483997324,16cyclictest0-21swapper/021:19:590
6495997245,16cyclictest373-21lldpd21:21:032
6495997210,30cyclictest24238-21sed21:15:202
6495997210,30cyclictest24238-21sed21:15:202
6483997256,11cyclictest6472-21cyclictest19:45:190
6483997255,11cyclictest3081-21sshd23:22:480
6483997236,29cyclictest27721-21ssh22:15:120
6483997224,33cyclictest0-21swapper/022:05:070
6495997148,12cyclictest0-21swapper/222:04:462
6483997146,19cyclictest17496-21ssh22:52:480
6483997146,19cyclictest17496-21ssh22:52:480
6483997142,21cyclictest982-21latency_hist20:19:470
648399712,37cyclictest30534-21awk22:20:080
44032710,6sleep3451rcuc/320:29:543
6495997051,13cyclictest3522-21ntp_offset21:35:142
6495997051,13cyclictest3522-21ntp_offset21:35:142
6495997045,18cyclictest32734-21ssh21:30:082
6495997041,19cyclictest0-21swapper/223:10:052
6495997041,19cyclictest0-21swapper/223:10:052
6495997038,21cyclictest4296-21latency_hist20:29:472
6495997033,26cyclictest10647-21systemd-run20:49:452
649599702,35cyclictest23694-21sendmail-msp19:49:442
6495997016,18cyclictest559-21runrttasks00:12:392
6495997016,18cyclictest559-21runrttasks00:12:392
6483997053,11cyclictest32061-21ssh23:16:210
6483997042,19cyclictest14071-21diskmemload21:35:130
6483997042,19cyclictest14071-21diskmemload21:35:130
6483997038,23cyclictest27133-21latency_hist19:59:490
6483997030,31cyclictest0-21swapper/022:14:460
6483997030,31cyclictest0-21swapper/022:14:460
6483997015,28cyclictest798-21cat22:25:020
6495996946,16cyclictest5393-21sh00:20:172
6495996945,12cyclictest0-21swapper/220:34:462
6495996941,19cyclictest7575-21latency_hist20:39:472
6495996914,24cyclictest29124-21unixbench_multi00:05:212
6483996939,24cyclictest0-21swapper/021:14:460
6483996933,29cyclictest6331-21kworker/u17:3+xprtiod22:45:450
44572690,8sleep20-21swapper/200:19:462
650299684,36cyclictest0-21swapper/319:05:073
649599688,25cyclictest0-21swapper/200:00:012
649599688,25cyclictest0-21swapper/200:00:012
6495996845,11cyclictest0-21swapper/222:49:462
6495996842,18cyclictest27037-21latency_hist22:14:472
6495996842,18cyclictest27037-21latency_hist22:14:472
6495996838,22cyclictest1747-21wc20:20:162
6495996838,22cyclictest1747-21wc20:20:162
6483996850,12cyclictest297-21systemd-logind20:09:450
6483996839,21cyclictest1424-21kworker/u17:2+xprtiod00:29:380
6483996839,21cyclictest1424-21kworker/u17:2+xprtiod00:29:380
6483996838,23cyclictest15918-21kworker/u17:1+xprtiod23:45:120
6483996836,26cyclictest121722sleep021:49:570
6483996835,8cyclictest181rcu_preempt20:50:320
6483996835,8cyclictest181rcu_preempt20:50:320
6483996835,26cyclictest12344-21kworker/u17:4+xprtiod21:59:380
648399682,34cyclictest352-21runrttasks00:04:350
648399682,34cyclictest352-21runrttasks00:04:350
648399680,19cyclictest20708-21runrttasks19:39:570
6495996734,20cyclictest11908-21apt-key21:49:482
6495996734,20cyclictest11908-21apt-key21:49:482
6495996713,24cyclictest16465-21taskset21:56:142
6483996745,16cyclictest544-21cron20:39:440
6483996744,15cyclictest1-21systemd19:54:450
6483996740,21cyclictest0-21swapper/020:54:550
6483996738,22cyclictest7986-21cron19:04:440
6483996737,23cyclictest30307-21/usr/sbin/munin23:14:460
6483996737,23cyclictest30307-21/usr/sbin/munin23:14:460
648399672,51cyclictest6875-21tune2fs22:35:060
648399672,51cyclictest6875-21tune2fs22:35:060
648399672,30cyclictest16165-21awk19:26:080
649599665,27cyclictest14453-21cpu21:00:002
649599665,27cyclictest14453-21cpu21:00:002
6495996649,11cyclictest18926-21kworker/u17:0-xprtiod23:02:152
6495996642,17cyclictest21299-21cpuspeed22:05:002
6495996634,26cyclictest15930-21idleruntime-cro23:44:432
649599663,22cyclictest30951-21sort23:15:062
6495996620,10cyclictest0-21swapper/219:14:452
6483996650,9cyclictest0-21swapper/000:14:430
6483996650,9cyclictest0-21swapper/000:14:430
6483996642,18cyclictest32326-1kworker/0:2H+kblockd22:00:100
648399663,33cyclictest9212-21/usr/sbin/munin20:45:090
100262666,10sleep30-21swapper/320:45:183
6495996544,15cyclictest23191-21latency_hist21:14:462
6495996534,21cyclictest23867-21kworker/u19:1+nfsiod23:34:472
6495996534,21cyclictest23867-21kworker/u19:1+nfsiod23:34:472
649599653,22cyclictest14729-21modprobe21:54:442
6495996521,38cyclictest0-21swapper/223:49:562
6495996511,21cyclictest1759-21ssh22:25:242
6483996540,18cyclictest5224-21timerwakeupswit20:30:180
6483996539,19cyclictest30482-21uptime21:25:230
6483996538,20cyclictest30392-21/usr/sbin/munin20:10:100
6483996538,20cyclictest12640-21netstat19:15:110
6483996538,20cyclictest12640-21netstat19:15:110
6483996537,22cyclictest9707-21swap21:45:200
6483996537,22cyclictest9707-21swap21:45:200
6495996443,10cyclictest0-21swapper/220:44:462
6495996439,16cyclictest29661-21unixbench_multi20:05:192
649599643,41cyclictest13389-21runrttasks19:18:082
649599643,41cyclictest13389-21runrttasks19:18:082
6495996421,37cyclictest0-21swapper/219:54:562
6483996428,27cyclictest0-21swapper/000:15:180
648399642,45cyclictest4852-21fschecks_time00:20:040
649599638,10cyclictest181rcu_preempt19:00:092
6495996330,25cyclictest8313-21sshd22:37:042
6495996330,25cyclictest8313-21sshd22:37:042
650299623,50cyclictest12208-21chrt21:50:153
649599622,46cyclictest352-21runrttasks20:57:522
6483996237,18cyclictest6590-21latency_hist18:59:490
6483996237,18cyclictest6590-21latency_hist18:59:490
650299617,44cyclictest0-21swapper/322:55:083
650299617,44cyclictest0-21swapper/322:55:083
650299613,43cyclictest4290-21chrt00:19:433
6495996141,12cyclictest24047-21cstates19:50:022
6495996141,10cyclictest0-21swapper/223:20:072
650299607,38cyclictest0-21swapper/319:39:583
6495996019,29cyclictest17677-21cat19:30:102
6495996019,29cyclictest17677-21cat19:30:102
6483995832,19cyclictest0-21swapper/019:10:200
650299573,39cyclictest28658-21chrt23:10:213
650299573,39cyclictest28658-21chrt23:10:213
649599573,35cyclictest30392-21/usr/sbin/munin20:10:012
648399573,37cyclictest7875-21fschecks_time20:40:050
650299564,33cyclictest2819-21chrt21:34:473
650299563,38cyclictest3694-21chrt20:25:203
650299563,35cyclictest22492-21taskset23:55:083
650299562,42cyclictest19218-21chrt21:07:233
650299562,42cyclictest1702-21taskset20:20:143
650299562,42cyclictest1702-21taskset20:20:143
650299543,34cyclictest19212-21chrt23:49:533
650299534,40cyclictest699-21taskset00:13:033
650299534,40cyclictest699-21taskset00:13:033
650299533,39cyclictest5642-21chrt21:39:463
650299533,39cyclictest5642-21chrt21:39:463
650299533,36cyclictest4799-21chrt23:25:163
650299533,36cyclictest18603-21chrt22:54:483
650299533,35cyclictest28871-21taskset21:24:133
650299533,35cyclictest24948-21taskset19:50:373
650299532,39cyclictest14736-21taskset19:20:203
650299532,36cyclictest31569-21chrt23:15:193
6502995319,18cyclictest0-21swapper/321:59:483
650299524,36cyclictest24927-21taskset23:05:063
650299523,36cyclictest12441-21chrt22:44:473
650299523,34cyclictest23452-21taskset21:15:013
650299523,34cyclictest23452-21taskset21:15:013
650299523,33cyclictest29396-21chrt22:18:333
650299522,37cyclictest26039-21taskset22:12:253
650299522,37cyclictest26039-21taskset22:12:253
650299514,32cyclictest30628-21chrt20:10:053
650299513,34cyclictest23695-21chrt19:49:443
650299513,33cyclictest17237-21chrt21:04:473
650299513,33cyclictest17237-21chrt21:04:473
650299512,38cyclictest23009-21taskset22:07:183
650299512,37cyclictest17406-21chrt23:45:313
650299512,35cyclictest8005-21chrt00:25:103
650299512,35cyclictest8005-21chrt00:25:103
650299512,35cyclictest30467-21chrt00:08:533
650299506,32cyclictest20373-21taskset21:09:503
650299503,36cyclictest12382-21taskset19:15:053
650299503,36cyclictest12382-21taskset19:15:053
650299503,35cyclictest15787-21chrt22:50:063
650299503,33cyclictest875-21taskset22:25:063
650299503,33cyclictest3724-21chrt22:30:003
650299502,37cyclictest26659-21taskset00:01:283
650299502,37cyclictest26659-21taskset00:01:283
650299502,35cyclictest10181-21taskset21:45:503
650299502,35cyclictest10181-21taskset21:45:503
650299493,37cyclictest7476-21chrt23:30:073
650299493,37cyclictest7476-21chrt23:30:073
650299493,35cyclictest13631-21chrt23:40:083
650299493,31cyclictest20603-21taskset19:39:483
650299492,37cyclictest29891-21taskset21:25:113
650299492,34cyclictest30170-21chrt20:09:453
650299492,32cyclictest1070-21taskset23:19:493
650299483,34cyclictest31723-21taskset22:21:453
650299483,33cyclictest13582-21chrt20:55:193
650299483,32cyclictest7490-21chrt21:41:413
650299483,32cyclictest7340-21chrt00:24:463
650299482,33cyclictest12858-21chrt22:45:073
650299473,32cyclictest10857-21chrt19:10:073
650299463,35cyclictest17736-21taskset19:30:123
650299463,35cyclictest17736-21taskset19:30:123
650299462,31cyclictest21715-21chrt22:59:593
650299462,29cyclictest27055-21taskset19:59:493
650299454,31cyclictest7998-21chrt19:04:443
650299452,34cyclictest7620-21chrt20:39:543
650299452,29cyclictest32355-21chrt20:15:083
650299433,27cyclictest7793-21chrt22:35:353
650299433,27cyclictest7793-21chrt22:35:353
650299433,26cyclictest6392-21chrt20:35:083
650299405,25cyclictest28367-21chrt20:03:093
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional