You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-03 - 06:04
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot7.osadl.org (updated Mon Aug 03, 2026 00:44:30)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
69979911242,61cyclictest0-21swapper/019:21:180
69979910931,47cyclictest0-21swapper/000:07:250
69979910545,52cyclictest0-21swapper/000:16:430
6789210518,58sleep26825-21unin-run18:55:452
663321056,16sleep10-21swapper/118:54:301
6997991023,62cyclictest26697-21seq23:02:070
6997991023,62cyclictest26697-21seq23:02:070
6997991004,84cyclictest14435-21apt-get19:15:550
658821000,8sleep20-21swapper/223:21:182
658821000,8sleep20-21swapper/223:21:182
699799993,81cyclictest13409-21apt-get20:50:550
6997999924,49cyclictest0-21swapper/020:08:130
699799983,84cyclictest0-21swapper/020:00:550
699799982,90cyclictest0-21swapper/021:00:550
6997999823,47cyclictest21178-21kworker/u17:2+xprtiod22:57:410
6997999823,47cyclictest21178-21kworker/u17:2+xprtiod22:57:410
6997999739,50cyclictest0-21swapper/023:40:590
699799973,85cyclictest0-21swapper/022:30:540
6997999720,47cyclictest352-21runrttasks21:08:590
6997999720,47cyclictest352-21runrttasks21:08:590
6997999629,47cyclictest0-21swapper/019:06:480
557229610,63sleep05388-21/usr/sbin/munin18:51:100
6997999527,61cyclictest0-21swapper/023:36:090
6997999527,61cyclictest0-21swapper/023:36:090
6997999527,48cyclictest0-21swapper/019:55:170
6997999521,49cyclictest0-21swapper/022:48:090
6997999515,45cyclictest4807-21sh21:31:270
6997999515,45cyclictest4807-21sh21:31:270
7006999477,10cyclictest23291-21cron23:50:421
6997999447,41cyclictest6865-21ssh23:21:430
6997999447,41cyclictest6865-21ssh23:21:430
6997999441,46cyclictest0-21swapper/021:26:100
699799933,80cyclictest0-21swapper/021:50:580
6997999336,51cyclictest0-21swapper/023:51:010
6997999336,51cyclictest0-21swapper/023:51:010
6997999327,57cyclictest15350irq/295-2188000.ethernet21:35:570
6997999318,60cyclictest25664-21kworker/u17:0+rpciod21:50:460
699799924,78cyclictest0-21swapper/020:31:000
699799914,79cyclictest5089-21apt-get20:25:540
699799914,78cyclictest0-21swapper/019:55:570
699799913,79cyclictest1-21systemd23:10:430
699799913,78cyclictest5193-21ssh00:13:180
699799904,81cyclictest0-21swapper/022:35:530
699799904,77cyclictest31405-21fschecks_time22:16:050
699799893,81cyclictest0-21swapper/022:41:000
699799893,81cyclictest0-21swapper/022:41:000
699799893,78cyclictest0-21swapper/020:21:400
6997998936,46cyclictest0-21swapper/019:00:510
6997998936,46cyclictest0-21swapper/019:00:510
699799884,62cyclictest29848-21apt-get00:01:100
699799883,78cyclictest9871-21grep19:01:320
6997998833,51cyclictest6976-21cyclictest23:50:060
699799882,77cyclictest10908-21grep21:42:230
699799872,79cyclictest2238-21grep22:21:110
699799872,75cyclictest17930-21latency_hist21:00:460
699799872,75cyclictest17930-21latency_hist21:00:460
7027998648,14cyclictest24855-21nfs4_client19:46:122
699799863,78cyclictest0-21swapper/021:55:560
699799863,77cyclictest0-21swapper/021:11:010
699799863,74cyclictest8639-21apt-get23:25:530
699799863,70cyclictest8313-21apt-get20:35:540
6997998633,46cyclictest0-21swapper/022:55:450
6997998633,46cyclictest0-21swapper/022:55:450
6997998633,46cyclictest0-21swapper/020:16:180
699799862,79cyclictest0-21swapper/022:00:570
699799853,75cyclictest32123-21ssh23:10:570
699799853,75cyclictest32123-21ssh23:10:570
699799853,75cyclictest14751-21diskmemload22:10:570
699799853,72cyclictest0-21swapper/019:10:560
699799852,70cyclictest11739-21sed20:45:460
699799852,54cyclictest480-21latency_hist21:25:460
6997998523,55cyclictest12055-21grep20:46:060
702799848,63cyclictest26219-21kworker/u17:3+ext4-rsv-conversion00:00:582
699799844,72cyclictest26906-21cut23:56:040
6997998432,45cyclictest0-21swapper/019:35:460
7006998366,11cyclictest277-21dbus-daemon00:00:431
6997998329,47cyclictest0-21swapper/019:41:100
6997998329,47cyclictest0-21swapper/019:41:100
699799832,69cyclictest24378-21apt-get19:45:560
699799824,71cyclictest0-21swapper/019:36:070
699799823,74cyclictest0-21swapper/022:25:530
699799823,73cyclictest0-21swapper/022:06:080
699799823,73cyclictest0-21swapper/022:06:080
699799822,74cyclictest3696-21grep23:16:190
6997998227,48cyclictest0-21swapper/000:23:510
7027998160,15cyclictest3203-21latency_hist00:10:452
700699812,61cyclictest16881-21apt-get22:46:411
699799813,73cyclictest0-21swapper/021:15:590
6997998128,47cyclictest11624-21/usr/sbin/munin23:31:070
7027998060,13cyclictest2374-21systemd-journal23:01:352
7027998060,13cyclictest2374-21systemd-journal23:01:352
7027998057,14cyclictest6976-21cyclictest22:10:452
7027998057,14cyclictest6976-21cyclictest22:10:452
7027998055,15cyclictest1-21systemd22:33:462
7006998066,10cyclictest6976-21cyclictest22:51:191
7006998066,10cyclictest6976-21cyclictest22:51:191
7006998054,15cyclictest0-21swapper/123:31:051
704199793,61cyclictest16663-21chrt21:51:173
7027997965,10cyclictest6976-21cyclictest20:46:002
7027997962,11cyclictest13439-21latency_hist22:40:452
7027997953,20cyclictest2374-21systemd-journal21:35:432
7027997953,20cyclictest2374-21systemd-journal21:35:432
7027997950,20cyclictest6062-21latency_hist00:15:452
699799793,65cyclictest32455-21apt-get20:10:540
699799793,65cyclictest32455-21apt-get20:10:540
7027997861,11cyclictest29430-21fschecks_time20:01:042
7027997857,14cyclictest2374-21systemd-journal23:51:342
7027997857,14cyclictest2374-21systemd-journal23:51:342
7027997856,12cyclictest0-21swapper/220:40:472
702799783,54cyclictest9336-21apt-get21:41:102
7006997860,9cyclictest0-21swapper/120:42:051
700699784,62cyclictest29848-21apt-get00:01:001
699799783,67cyclictest18302-21systemctl19:26:140
7027997762,10cyclictest6976-21cyclictest20:15:472
7027997757,13cyclictest15795-21ssh20:56:162
7027997757,13cyclictest15795-21ssh20:56:162
702799772,65cyclictest17171-21cron22:46:422
7006997758,11cyclictest0-21swapper/120:31:201
7006997746,22cyclictest12559-21cron19:10:421
7027997632,30cyclictest9642-21grep23:26:182
7006997661,7cyclictest0-21swapper/121:00:461
7006997661,7cyclictest0-21swapper/121:00:461
7006997634,31cyclictest7297-21apt-get18:56:131
7006997634,31cyclictest7297-21apt-get18:56:131
7027997559,9cyclictest0-21swapper/221:10:452
7027997559,9cyclictest0-21swapper/221:10:452
7027997553,12cyclictest0-21swapper/221:55:462
7027997551,16cyclictest13309-21ntp_kernel_err19:11:122
7006997560,9cyclictest9868-21apt-key20:40:451
7006997557,9cyclictest0-21swapper/121:05:441
7006997556,12cyclictest0-21swapper/119:15:451
7006997555,10cyclictest0-21swapper/121:50:451
704199743,59cyclictest26782-21chrt21:15:433
7027997458,8cyclictest0-21swapper/222:26:152
7027997458,10cyclictest6751-21kworker/u17:1-rpciod23:07:482
7027997454,10cyclictest0-21swapper/223:46:042
7027997450,7cyclictest181rcu_preempt21:16:202
702799743,29cyclictest13434-21needreboot21:46:102
7006997460,8cyclictest11313-21kworker/u18:323:30:411
7006997459,8cyclictest0-21swapper/122:21:201
7006997454,9cyclictest0-21swapper/122:31:071
7006997453,10cyclictest0-21swapper/122:16:071
7006997452,14cyclictest1540-21latency_hist20:15:461
7006997452,14cyclictest1540-21latency_hist20:15:461
7006997451,15cyclictest2374-21systemd-journal23:55:351
7006997451,15cyclictest2374-21systemd-journal23:55:351
7006997425,10cyclictest181rcu_preempt19:46:071
704199734,56cyclictest9098-21taskset19:01:043
704199734,56cyclictest9098-21taskset19:01:043
7027997357,10cyclictest28257-21ssh22:11:022
7006997359,8cyclictest0-21swapper/121:21:171
7006997354,9cyclictest0-21swapper/122:36:171
7006997354,10cyclictest0-21swapper/122:11:201
7006997353,14cyclictest5299-21idleruntime-cro23:20:421
7006997348,16cyclictest6631-21grep23:21:191
7006997348,16cyclictest6631-21grep23:21:191
700699733,54cyclictest24569-21apt-get22:06:021
700699733,54cyclictest24569-21apt-get22:06:021
7041997256,7cyclictest0-21swapper/300:00:563
704199723,36cyclictest1194-21taskset22:20:233
7027997254,11cyclictest277-21dbus-daemon00:00:432
7027997253,13cyclictest19453-21ntp_kernel_err21:56:102
7027997253,10cyclictest0-21swapper/220:31:072
7027997246,14cyclictest0-21swapper/219:20:452
7006997256,7cyclictest0-21swapper/120:50:451
7006997255,12cyclictest0-21swapper/123:00:461
7006997255,12cyclictest0-21swapper/123:00:461
7006997255,10cyclictest0-21swapper/119:51:171
7006997250,13cyclictest1-21systemd23:05:471
7006997250,13cyclictest1-21systemd23:05:471
700699723,55cyclictest9889-21apt-get21:41:031
42022720,8sleep239-21ksoftirqd/222:25:252
704199714,55cyclictest8465-21chrt23:25:453
704199714,55cyclictest8465-21chrt23:25:453
704199714,54cyclictest23792-21taskset23:51:023
704199714,54cyclictest23792-21taskset23:51:023
704199713,55cyclictest15814-21taskset19:20:453
704199713,34cyclictest970-21chrt21:26:043
7027997155,10cyclictest4809-21sendmail20:25:422
7027997151,10cyclictest0-21swapper/221:21:192
7027997151,10cyclictest0-21swapper/221:15:452
7027997139,23cyclictest13912-21fschecks_count22:41:072
7027997139,23cyclictest13912-21fschecks_count22:41:072
7006997156,6cyclictest0-21swapper/122:01:001
7006997154,11cyclictest21126-21apt-get19:36:031
7006997147,13cyclictest17460-21sshd00:19:351
704199704,53cyclictest10308-21chrt00:21:183
704199703,36cyclictest19080-21taskset19:30:453
704199703,35cyclictest3964-21chrt22:24:453
7027997054,10cyclictest25723-21apt-config23:00:452
7027997054,10cyclictest25723-21apt-config23:00:452
7027997054,10cyclictest22683-21switchtime22:01:172
7027997050,15cyclictest6976-21cyclictest19:00:532
7027997050,15cyclictest6976-21cyclictest19:00:532
7027997049,11cyclictest0-21swapper/219:06:042
7006997055,9cyclictest0-21swapper/122:41:171
7006997055,9cyclictest0-21swapper/122:41:171
7006997055,7cyclictest0-21swapper/120:10:451
7006997051,9cyclictest0-21swapper/121:51:061
7006997051,11cyclictest28264-21sshd21:16:351
7006997024,9cyclictest301ktimers/120:51:001
704199693,54cyclictest2131-21taskset00:08:053
704199693,35cyclictest27742-21taskset19:56:013
704199693,32cyclictest32614-21taskset20:11:043
704199693,32cyclictest32614-21taskset20:11:043
702799699,48cyclictest6608-21apt-get00:16:062
7027996955,9cyclictest58-21kcompactd022:53:492
7027996955,9cyclictest58-21kcompactd022:53:492
7027996948,10cyclictest0-21swapper/221:36:062
7006996951,12cyclictest11085-21ntpd00:11:111
704199684,52cyclictest18130-21chrt22:47:073
704199683,34cyclictest22808-21chrt22:01:183
7027996850,12cyclictest11529-21tr20:45:422
7027996843,17cyclictest0-21swapper/223:11:172
7027996843,17cyclictest0-21swapper/223:11:172
7006996852,12cyclictest6976-21cyclictest21:36:061
7006996852,10cyclictest2374-21systemd-journal20:20:431
7006996849,13cyclictest24658-21sh21:11:151
704199674,32cyclictest18471-21chrt21:01:073
704199673,50cyclictest17571-21taskset21:00:143
704199673,50cyclictest17571-21taskset21:00:143
704199673,33cyclictest17625-21chrt23:40:573
704199673,32cyclictest9619-21taskset19:01:243
704199673,32cyclictest32389-21chrt21:24:393
704199673,32cyclictest23059-21chrt21:08:453
704199673,32cyclictest23059-21chrt21:08:453
704199673,31cyclictest5392-21chrt00:13:523
7027996750,12cyclictest23064-21if_eth019:41:082
7027996750,12cyclictest23064-21if_eth019:41:082
7027996748,8cyclictest181rcu_preempt23:37:532
7027996748,8cyclictest181rcu_preempt23:37:532
7027996747,11cyclictest0-21swapper/219:36:172
7027996747,10cyclictest0-21swapper/222:16:002
7027996746,7cyclictest181rcu_preempt23:44:282
7027996746,15cyclictest17995-21if_eth019:26:042
7027996746,11cyclictest0-21swapper/220:11:012
7027996746,11cyclictest0-21swapper/220:11:012
7006996755,7cyclictest0-21swapper/121:31:171
7006996755,7cyclictest0-21swapper/121:31:171
7006996751,8cyclictest0-21swapper/123:36:011
7006996751,8cyclictest0-21swapper/123:36:011
7006996746,14cyclictest23770-21latency_hist21:10:461
7006996746,14cyclictest23770-21latency_hist21:10:461
7006996735,23cyclictest19008-21modprobe19:30:431
704199665,49cyclictest0-21swapper/320:00:583
704199664,49cyclictest25731-21taskset19:50:423
704199664,49cyclictest22854-21chrt23:49:283
704199663,35cyclictest20649-21chrt19:35:433
704199663,34cyclictest9763-21taskset23:26:223
704199663,33cyclictest29564-21chrt23:06:203
704199663,33cyclictest12377-21chrt22:38:073
704199662,33cyclictest15444-21taskset21:50:203
704199662,33cyclictest12867-21taskset23:31:413
704199662,32cyclictest29704-21chrt22:12:423
7027996651,7cyclictest0-21swapper/221:01:002
7027996650,10cyclictest297-21systemd-logind19:55:432
7027996648,13cyclictest2619-21acpi23:15:532
7006996652,8cyclictest0-21swapper/121:56:001
7006996649,12cyclictest10279-21proc_pri00:21:181
7006996646,15cyclictest0-21swapper/119:31:051
7006996645,14cyclictest0-21swapper/119:16:201
704199653,52cyclictest0-21swapper/321:55:563
704199653,31cyclictest7180-21chrt21:36:103
704199653,31cyclictest6702-21chrt20:30:573
704199653,31cyclictest5072-21chrt21:32:123
704199653,31cyclictest5072-21chrt21:32:123
704199653,31cyclictest16686-21chrt23:39:023
704199653,31cyclictest16686-21chrt23:39:023
704199652,32cyclictest8202-21taskset00:17:423
704199652,32cyclictest26613-21taskset23:55:523
704199652,32cyclictest12893-21chrt19:11:003
704199652,31cyclictest5387-21chrt22:26:153
7027996548,9cyclictest0-21swapper/219:35:472
7027996546,9cyclictest0-21swapper/220:26:082
7027996545,10cyclictest0-21swapper/220:51:192
7027996541,6cyclictest181rcu_preempt23:35:092
7027996539,17cyclictest1-21systemd21:29:352
7006996549,8cyclictest0-21swapper/122:30:461
7006996549,11cyclictest0-21swapper/120:22:051
7006996548,10cyclictest0-21swapper/119:05:421
7006996544,17cyclictest21178-21kworker/u17:2+events_unbound23:15:421
7006996544,17cyclictest21178-21kworker/u17:2+events_unbound23:15:421
700699652,23cyclictest31-21ksoftirqd/100:08:481
704199643,49cyclictest22884-21chrt19:41:023
704199643,49cyclictest22884-21chrt19:41:023
704199643,48cyclictest25295-21chrt22:06:133
704199643,48cyclictest25295-21chrt22:06:133
704199643,31cyclictest31956-21chrt20:07:563
704199643,31cyclictest25151-21chrt22:59:393
704199643,31cyclictest25151-21chrt22:59:393
704199643,31cyclictest22221-21chrt22:54:493
704199643,31cyclictest22221-21chrt22:54:493
704199643,31cyclictest10103-21taskset22:35:073
704199642,32cyclictest908-21taskset23:11:473
704199642,32cyclictest908-21taskset23:11:473
704199642,31cyclictest28227-21chrt23:04:133
704199642,31cyclictest28227-21chrt23:04:133
704199642,31cyclictest10135-21chrt20:40:533
704199642,30cyclictest10479-21taskset21:42:093
7027996449,7cyclictest0-21swapper/219:01:082
7027996441,7cyclictest181rcu_preempt00:22:572
7006996444,14cyclictest803-21sendmail-mta21:30:231
700699643,23cyclictest31-21ksoftirqd/123:10:291
704199634,29cyclictest28680-21chrt21:17:463
704199634,28cyclictest9328-21chrt20:36:403
704199633,29cyclictest5095-21chrt23:20:103
704199633,29cyclictest12874-21chrt20:47:253
704199632,30cyclictest17217-21taskset19:23:443
7027996347,10cyclictest16521-21ntp_kernel_err19:21:102
7027996342,7cyclictest181rcu_preempt19:58:422
704199622,30cyclictest22254-21chrt19:38:073
704199622,29cyclictest12272-21chrt19:07:083
7006996248,9cyclictest6976-21cyclictest19:21:181
704199613,33cyclictest15122-21chrt22:42:243
704199613,33cyclictest15122-21chrt22:42:243
704199612,29cyclictest14472-21chrt20:52:193
704199612,27cyclictest4776-21chrt20:25:383
704199612,27cyclictest2626-21chrt20:16:433
7027996146,9cyclictest0-21swapper/220:06:072
7006996147,8cyclictest0-21swapper/120:05:441
7006996146,8cyclictest0-21swapper/123:41:061
7006996022,8cyclictest301ktimers/119:41:031
7006996022,8cyclictest301ktimers/119:41:031
704199593,25cyclictest6276-21chrt20:28:543
704199592,23cyclictest25996-21chrt19:50:553
7006995946,7cyclictest0-21swapper/119:56:111
7006995941,12cyclictest0-21swapper/120:26:081
617025414,25sleep30-21swapper/318:51:303
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional