You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-18 - 09:47
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Tue Aug 18, 2026 00:44:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
11706214511,37sleep011709-21apt-get19:05:010
13329991083,36cyclictest32231-21runrttasks23:10:191
13329991083,36cyclictest32231-21runrttasks23:10:191
133419910538,13cyclictest0-21swapper/219:20:102
13341991053,62cyclictest15688-21apt-get20:55:022
133299910535,35cyclictest0-21swapper/100:29:501
13329991032,26cyclictest11366-21seq22:36:591
13329991022,31cyclictest20422-21sh23:43:561
13329991013,31cyclictest19965-21/usr/sbin/munin22:00:151
133299910041,34cyclictest353-21runrttasks23:07:371
208882980,6sleep30-21swapper/321:10:023
13329999854,37cyclictest297-21in:imuxsock20:09:481
1332999973,72cyclictest24471-21ssh23:50:061
1332999973,55cyclictest10854-21ssh00:20:051
1332999973,31cyclictest14321-21seq23:34:221
1332999944,64cyclictest0-21swapper/123:39:481
1332999944,64cyclictest0-21swapper/123:39:481
13329999348,38cyclictest19569-21switchtime19:25:251
13329999348,38cyclictest19569-21switchtime19:25:251
13329999250,36cyclictest28186-21sh23:04:491
1248129221,33sleep10-21swapper/119:05:351
13341999170,15cyclictest19270-21sh21:58:542
13341999170,15cyclictest19270-21sh21:58:542
13329999149,35cyclictest29300-21systemd-run22:14:501
13329999149,35cyclictest29300-21systemd-run22:14:501
1332999912,27cyclictest82372ssh22:31:581
1332999912,27cyclictest82372ssh22:31:581
1332999903,47cyclictest13844-21apt-get20:50:011
1334199892,56cyclictest22791-21apt-get22:05:032
13286998860,18cyclictest968-21sh21:30:030
1328699883,61cyclictest15-21ksoftirqd/022:00:260
13341998767,14cyclictest15148-21munin-node23:10:252
13341998767,14cyclictest15148-21munin-node23:10:252
1334199872,69cyclictest30684-21diskmemload23:59:512
1332999873,8cyclictest0-21swapper/123:45:001
1332999873,6cyclictest0-21swapper/122:45:001
1332999873,65cyclictest13047-21apt-get19:10:041
1332999872,7cyclictest0-21swapper/121:35:051
1332999872,7cyclictest0-21swapper/121:35:051
1334199865,55cyclictest10590-21apt-get21:45:082
1334199865,55cyclictest10590-21apt-get21:45:082
13341998631,13cyclictest0-21swapper/200:35:262
1332999862,25cyclictest32717-21ssh21:28:551
1328699862,53cyclictest15-21ksoftirqd/022:26:400
13341998564,15cyclictest32663-21latency_hist22:19:522
1332999852,35cyclictest10619-21apt-get20:40:051
1332999852,35cyclictest10619-21apt-get20:40:051
1332999852,28cyclictest3651-21ssh00:08:091
13286998553,25cyclictest13257-21cyclictest00:06:340
13329998463,15cyclictest296-21systemd-logind22:54:481
13329998439,39cyclictest0-21swapper/120:39:481
1332999843,8cyclictest0-21swapper/120:15:021
13329998438,40cyclictest0-21swapper/122:55:161
1332999843,35cyclictest13713-21sh21:50:011
1332999843,33cyclictest17234-21apt-get19:19:591
1332999843,32cyclictest19940-21/usr/sbin/munin21:05:241
1332999842,7cyclictest0-21swapper/119:15:031
1328699846,44cyclictest15-21ksoftirqd/020:44:520
1328699846,44cyclictest15-21ksoftirqd/020:44:520
13286998464,14cyclictest20534-21diskmemload21:46:530
13286998464,14cyclictest20534-21diskmemload21:46:530
13286998460,18cyclictest17377-21latency_hist20:59:510
13286998456,19cyclictest8160-21latency00:15:130
13286998446,14cyclictest181rcu_preempt22:22:290
13286998423,37cyclictest15-21ksoftirqd/023:19:500
13341998365,13cyclictest13824-21sh00:24:522
13329998338,37cyclictest0-21swapper/119:55:061
1332999833,62cyclictest23349-21apt-get22:05:401
1332999832,37cyclictest20987-21ntp_states19:30:191
1332999832,37cyclictest20987-21ntp_states19:30:191
1332999832,30cyclictest3623-21taskset22:25:091
1332999832,12cyclictest15688-21apt-get20:55:111
13341998264,13cyclictest4056-21sh23:17:092
13341998263,14cyclictest2828-21sh22:24:092
13341998252,10cyclictest181rcu_preempt20:39:512
1332999823,30cyclictest30675-21/usr/sbin/munin20:00:181
1332999823,27cyclictest6354-21ssh00:12:071
1332999823,27cyclictest12308-21/usr/sbin/munin20:45:051
1332999823,27cyclictest12308-21/usr/sbin/munin20:45:051
1332999822,38cyclictest17561-21apt-get21:00:121
1332999822,38cyclictest17561-21apt-get21:00:121
13286998259,16cyclictest19778-21latency_hist21:59:510
13286998259,16cyclictest19778-21latency_hist21:59:510
13286998211,42cyclictest15-21ksoftirqd/021:07:560
13341998161,14cyclictest16594-21latency_hist21:54:502
1332999813,38cyclictest28779-21/usr/sbin/munin23:57:011
1332999813,37cyclictest20919-21ssh00:35:241
1332999813,36cyclictest1810-21/usr/sbin/munin20:10:261
1332999813,36cyclictest1810-21/usr/sbin/munin20:10:261
1332999813,35cyclictest28259-21/usr/sbin/munin21:20:271
1332999813,34cyclictest7661-21rm00:14:571
1332999813,33cyclictest8602-21ssh23:25:041
1332999813,29cyclictest30453-21/usr/sbin/munin22:15:231
1332999812,29cyclictest878-21ntpq22:20:181
1332999812,25cyclictest8499-21sshd20:32:091
1328699816,45cyclictest15-21ksoftirqd/019:49:420
13286998160,14cyclictest22057-21latency_hist22:54:510
13286998158,16cyclictest299-21rs:main0
13286998158,16cyclictest299-21rs:main0
1328699815,39cyclictest15-21ksoftirqd/000:36:330
1328699814,50cyclictest15-21ksoftirqd/023:20:260
1328699814,50cyclictest15-21ksoftirqd/023:20:260
1328699814,49cyclictest15-21ksoftirqd/020:23:150
1328699813,50cyclictest15-21ksoftirqd/019:32:590
1328699813,50cyclictest15-21ksoftirqd/019:32:590
1313528112,39sleep213185-21apt-config19:09:522
13341998059,15cyclictest14652-21sh22:42:182
1332999803,6cyclictest0-21swapper/119:50:311
1332999803,38cyclictest17571-21ssh21:55:241
1332999803,38cyclictest17571-21ssh21:55:241
1332999803,36cyclictest9756-21ssh21:44:071
1332999803,36cyclictest21493-21/usr/sbin/munin21:10:181
1332999803,35cyclictest22138-21/usr/sbin/munin19:35:051
1332999803,31cyclictest26188-21taskset21:18:151
1332999803,31cyclictest24143-21/usr/sbin/munin19:40:161
1332999802,31cyclictest5621-21ssh23:20:071
1332999802,31cyclictest5621-21ssh23:20:071
1332999802,30cyclictest10948-21fschecks_time21:45:281
1332999802,30cyclictest10948-21fschecks_time21:45:281
1328699807,51cyclictest15-21ksoftirqd/019:42:480
1328699804,47cyclictest15-21ksoftirqd/022:55:510
1328699803,41cyclictest15-21ksoftirqd/023:29:250
13286998023,33cyclictest15-21ksoftirqd/000:04:480
13286998023,33cyclictest15-21ksoftirqd/000:04:480
13341997955,10cyclictest181rcu_preempt21:00:532
13341997955,10cyclictest181rcu_preempt21:00:532
1332999793,30cyclictest30567-40mandb23:59:531
1332999793,30cyclictest30567-40mandb23:59:531
1332999792,33cyclictest4614-21/usr/sbin/munin20:20:151
1332999792,31cyclictest5125-21basename23:19:481
1332999792,31cyclictest26828-21latency_hist19:50:291
13286997962,10cyclictest20534-21diskmemload23:05:050
1328699795,33cyclictest15-21ksoftirqd/021:15:170
1328699795,26cyclictest15-21ksoftirqd/019:20:230
1328699793,53cyclictest15-21ksoftirqd/020:04:510
1328699793,46cyclictest15-21ksoftirqd/000:28:080
1334999789,57cyclictest0-21swapper/323:59:513
13341997863,11cyclictest13257-21cyclictest21:10:162
1332999783,36cyclictest955-21ssh21:30:011
1332999782,6cyclictest0-21swapper/100:30:021
1332999782,36cyclictest15626-21latency_hist22:44:511
1328699786,41cyclictest15-21ksoftirqd/000:32:130
13286997859,13cyclictest15629-21munin-plugin-st22:44:500
13286997855,15cyclictest13257-21cyclictest23:37:170
13286997855,15cyclictest13257-21cyclictest23:37:170
1328699785,42cyclictest15-21ksoftirqd/020:33:420
1334999774,28cyclictest0-21swapper/322:05:033
1334199773,52cyclictest7075-21latency_hist21:39:512
1334199773,52cyclictest7075-21latency_hist21:39:512
1332999773,37cyclictest5776-21apt-get20:25:051
1328699779,45cyclictest15-21ksoftirqd/022:15:590
1328699774,41cyclictest15-21ksoftirqd/023:30:150
13286997738,29cyclictest0-21swapper/021:50:150
13286997733,31cyclictest32697-21grep20:05:240
1328699772,44cyclictest15-21ksoftirqd/021:13:020
1328699772,37cyclictest15-21ksoftirqd/021:00:360
1328699772,37cyclictest15-21ksoftirqd/021:00:360
1328699771,51cyclictest15-21ksoftirqd/020:19:120
1334999762,31cyclictest21240-21chrt00:35:333
13341997661,10cyclictest14427-21processes20:50:222
13341997655,16cyclictest4266-21sh00:09:472
13341997645,12cyclictest0-21swapper/223:51:222
13286997643,25cyclictest0-21swapper/022:05:030
13286997629,28cyclictest181rcu_preempt21:20:120
1328699762,36cyclictest15-21ksoftirqd/023:00:120
13286997610,47cyclictest82-21kswapd023:50:140
13341997560,11cyclictest13257-21cyclictest23:33:412
13341997550,19cyclictest32283-21ntp_offset20:05:162
1328699757,46cyclictest15-21ksoftirqd/000:22:160
13286997546,22cyclictest8565-21kworker/u17:3+nfsiod21:43:290
1328699754,60cyclictest19798-21unixbench_singl19:25:270
1328699754,60cyclictest19798-21unixbench_singl19:25:270
13341997459,10cyclictest13257-21cyclictest00:20:592
13341997456,13cyclictest16325-21kworker/u17:3+events_unbound23:39:482
13341997456,13cyclictest16325-21kworker/u17:3+events_unbound23:39:482
13341997455,13cyclictest27436-21fschecks_time21:20:112
13341997453,14cyclictest20534-21diskmemload21:30:132
13341997430,13cyclictest0-21swapper/222:54:492
13286997450,8cyclictest181rcu_preempt22:44:580
1328699743,42cyclictest15-21ksoftirqd/019:38:120
1328699742,62cyclictest29486-21sort22:14:520
1328699742,62cyclictest29486-21sort22:14:520
1328699742,48cyclictest15-21ksoftirqd/021:25:380
1334999733,32cyclictest30479-21chrt21:25:103
13341997336,14cyclictest2703-21fschecks_count20:15:102
1334199733,33cyclictest15859-21sort19:15:142
13341997324,11cyclictest181rcu_preempt22:28:142
1328699738,36cyclictest15-21ksoftirqd/020:28:520
13286997346,9cyclictest181rcu_preempt23:45:190
1334999723,29cyclictest4989-21chrt20:20:253
13341997247,16cyclictest9363-21sh22:34:492
13341997247,16cyclictest9363-21sh22:34:492
13341997242,11cyclictest181rcu_preempt19:50:552
1334199723,47cyclictest7115-21ls20:29:482
1328699727,50cyclictest14896-21sh19:14:480
1328699724,42cyclictest15-21ksoftirqd/019:50:380
1328699724,33cyclictest15-21ksoftirqd/020:50:120
13286997242,9cyclictest181rcu_preempt21:35:220
13286997242,9cyclictest181rcu_preempt21:35:220
1328699723,36cyclictest353-21runrttasks23:58:300
1328699722,40cyclictest15-21ksoftirqd/019:19:520
13341997150,15cyclictest20534-21diskmemload23:00:212
13341997128,8cyclictest181rcu_preempt19:10:122
13341997126,32cyclictest29354-21timerwakeupswit19:55:252
13286997151,13cyclictest287-21dbus-daemon19:59:480
13286997134,10cyclictest181rcu_preempt00:13:100
13286997118,22cyclictest15-21ksoftirqd/020:36:220
1334999703,31cyclictest21653-21chrt22:01:523
13341997050,14cyclictest1398-21nfs4_client20:10:172
13341997050,14cyclictest1398-21nfs4_client20:10:172
1334199704,49cyclictest22499-21fschecks_time22:55:102
1334199702,34cyclictest17027-21ssh00:30:032
1328699704,35cyclictest15-21ksoftirqd/022:34:120
1328699704,35cyclictest15-21ksoftirqd/022:34:120
1328699703,36cyclictest10043-21if_eth022:35:120
13286997025,22cyclictest181rcu_preempt23:13:080
13286997025,22cyclictest181rcu_preempt23:13:080
13286997015,27cyclictest15-21ksoftirqd/023:42:540
1334999693,29cyclictest27450-21chrt21:20:113
1334199697,11cyclictest0-21swapper/219:40:022
13341996949,14cyclictest10057-21apt-key21:44:492
13341996948,15cyclictest8661-21cpuspeed23:25:052
13341996850,12cyclictest31093-21switchtime21:25:252
13341996843,15cyclictest0-21swapper/222:49:512
13341996842,11cyclictest0-21swapper/221:15:002
13341996812,14cyclictest181rcu_preempt23:40:192
1334999678,44cyclictest0-21swapper/323:50:073
13341996738,20cyclictest19230-21grep19:25:162
13341996738,20cyclictest19230-21grep19:25:162
1334199673,43cyclictest4880-21fschecks_time00:10:092
1334199673,41cyclictest31496-21latency_hist20:04:512
1334199673,40cyclictest11956-21modprobe20:44:482
1334199673,40cyclictest11956-21modprobe20:44:482
1334199663,44cyclictest9900-21diskmemload22:35:102
1334199663,28cyclictest27324-21/usr/sbin/munin22:10:232
1334199663,28cyclictest27324-21/usr/sbin/munin22:10:232
13341996632,16cyclictest0-21swapper/200:15:312
1334199662,44cyclictest19965-21timerandwakeup21:05:242
13341996616,10cyclictest181rcu_preempt20:20:042
1328699664,39cyclictest15-21ksoftirqd/020:12:230
1328699664,39cyclictest15-21ksoftirqd/020:12:230
13349996511,24cyclictest0-21swapper/321:45:093
13349996511,24cyclictest0-21swapper/321:45:093
1334199653,46cyclictest23029-21grep19:35:252
13341996529,12cyclictest181rcu_preempt22:04:522
1334199652,46cyclictest7575-21grep20:30:112
13341996520,10cyclictest181rcu_preempt19:34:502
13341996520,10cyclictest181rcu_preempt19:34:502
13341996438,12cyclictest181rcu_preempt00:02:152
13341996438,12cyclictest181rcu_preempt00:02:152
1334199642,45cyclictest8343-21latency_hist23:24:502
1334199642,45cyclictest8343-21latency_hist23:24:502
13341996419,9cyclictest0-21swapper/223:49:382
13341996344,13cyclictest31180-21sh23:09:352
1334199633,43cyclictest25586-21fschecks_time19:45:212
13341996233,10cyclictest12851-21sendmail_mailst20:45:212
13341996233,10cyclictest12851-21sendmail_mailst20:45:212
1206226120,25sleep30-21swapper/319:05:203
1334999598,23cyclictest0-21swapper/320:55:023
1334999572,41cyclictest24569-21chrt22:58:433
1334999563,40cyclictest20713-21chrt23:44:423
1334999563,36cyclictest13902-21taskset22:40:273
1334999562,38cyclictest16940-21chrt22:45:253
1334999562,37cyclictest1370-21chrt20:10:163
1334999562,37cyclictest1370-21chrt20:10:163
1334999553,34cyclictest9525-21chrt20:35:193
1334999552,40cyclictest14261-21taskset23:34:123
1334999552,34cyclictest29035-21chrt19:55:183
1334999543,34cyclictest2558-21chrt23:15:083
1334999543,34cyclictest18590-21taskset19:24:493
1334999542,38cyclictest5846-21taskset20:25:073
1334999542,36cyclictest8271-21chrt20:30:253
1334999542,33cyclictest8912-21taskset00:15:433
167202530,6sleep30-21swapper/323:37:293
167202530,6sleep30-21swapper/323:37:293
1334999533,38cyclictest13770-21chrt19:11:003
1334999533,37cyclictest30027-21taskset22:15:133
1334999533,33cyclictest31654-21chrt23:10:053
1334999533,33cyclictest31654-21chrt23:10:053
1334999533,33cyclictest1829-21chrt00:05:133
13349995330,14cyclictest105602sleep322:35:253
1334999532,37cyclictest23585-21chrt19:39:513
1334999532,35cyclictest15809-21chrt19:15:133
1334999523,37cyclictest18525-21taskset00:31:323
1334999523,35cyclictest27307-21chrt19:50:443
1334999523,35cyclictest10377-21chrt21:44:513
1334999523,34cyclictest6244-21chrt22:29:483
1334999523,34cyclictest5533-21taskset21:36:203
1334999523,34cyclictest5533-21taskset21:36:203
1334999522,38cyclictest6246-21taskset23:20:233
1334999522,38cyclictest6246-21taskset23:20:233
1334999522,38cyclictest2071-21chrt22:22:103
1334999522,37cyclictest16342-21taskset21:54:263
1334999514,35cyclictest25553-21chrt19:45:183
1334999513,35cyclictest18921-21chrt21:04:473
1334999513,35cyclictest18921-21chrt21:04:473
1334999513,34cyclictest26457-21chrt22:09:583
1334999513,34cyclictest26457-21chrt22:09:583
1334999513,32cyclictest11603-21taskset23:29:513
1334999512,35cyclictest20409-21taskset22:51:003
1334999512,33cyclictest12208-21chrt20:44:593
1334999512,33cyclictest12208-21chrt20:44:593
1334999503,32cyclictest12157-21chrt00:21:023
1334999503,31cyclictest7514-21chrt22:30:253
1334999503,31cyclictest7514-21chrt22:30:253
1334999503,30cyclictest15068-21chrt00:25:323
1334999494,32cyclictest30413-21taskset23:07:343
1334999493,34cyclictest19692-21taskset21:59:493
1334999493,34cyclictest19692-21taskset21:59:493
1334999483,33cyclictest21964-21chrt23:45:233
1334999483,33cyclictest13999-21taskset20:50:093
1334999483,31cyclictest12029-21chrt20:44:513
1334999483,31cyclictest12029-21chrt20:44:513
1334999483,30cyclictest5265-21chrt00:10:193
1334999483,30cyclictest20761-21taskset19:30:113
1334999483,30cyclictest20761-21taskset19:30:113
13349994828,11cyclictest0-21swapper/321:30:263
1334999482,28cyclictest30818-21chrt23:59:543
1334999482,28cyclictest30818-21chrt23:59:543
1334999463,32cyclictest2920-21chrt20:15:143
1334999463,31cyclictest26311-21chrt23:00:253
1334999463,31cyclictest24526-21chrt21:15:173
1334999453,30cyclictest19720-21chrt21:05:203
1334999453,30cyclictest19298-21taskset19:25:173
1334999453,30cyclictest19298-21taskset19:25:173
1334999433,30cyclictest25066-21taskset19:44:493
1334999413,28cyclictest30599-21chrt20:00:163
1334999402,25cyclictest31768-21taskset20:05:023
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional