You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-09 - 16:38
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot7.osadl.org (updated Tue Jun 09, 2026 12:44:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
950125490,10sleep016483-1kworker/0:2H+mmc_complete06:54:480
109749910892,9cyclictest0-21swapper/212:19:282
109749910052,14cyclictest181rcu_preempt10:10:022
1097499963,69cyclictest10737-21apt-get11:29:432
10974999456,13cyclictest181rcu_preempt11:27:402
99322937,55sleep210023-21/usr/sbin/munin06:56:102
10974999053,13cyclictest181rcu_preempt07:06:592
10965999060,18cyclictest2073-21latency_hist12:09:290
10965999060,18cyclictest2073-21latency_hist12:09:290
10974998950,17cyclictest181rcu_preempt08:39:282
10974998832,13cyclictest10952-21cyclictest10:55:332
10974998832,13cyclictest10952-21cyclictest10:55:332
10974998760,11cyclictest181rcu_preempt06:59:572
10974998736,10cyclictest181rcu_preempt10:39:282
1098099853,39cyclictest25911-21taskset11:54:473
1098099853,39cyclictest25911-21taskset11:54:473
10974998551,14cyclictest30340-21ssh09:19:322
10965998554,21cyclictest27912-21latency_hist07:49:290
10974998464,14cyclictest17883-21diskmemload11:34:552
10974998454,20cyclictest19037-21threads07:20:012
10974998451,17cyclictest18953-21/usr/sbin/munin09:54:482
10965998421,36cyclictest0-21swapper/011:09:260
10974998354,12cyclictest181rcu_preempt10:49:422
10974998354,12cyclictest181rcu_preempt10:49:422
10974998328,11cyclictest181rcu_preempt12:12:222
10965998368,9cyclictest17883-21diskmemload12:20:210
10974998258,9cyclictest181rcu_preempt12:04:422
10974998258,9cyclictest181rcu_preempt12:04:422
10974998258,17cyclictest23880-21latency_hist09:09:302
1097499823,30cyclictest1270-21latency_hist10:19:292
10965998263,13cyclictest12138-21netstat08:39:530
1098099813,34cyclictest26315-21chrt11:00:173
1098099812,40cyclictest10664-21chrt08:34:593
10974998160,15cyclictest10589-21sh09:39:542
10974998157,9cyclictest181rcu_preempt11:13:432
10974998157,9cyclictest181rcu_preempt11:13:432
10974998156,10cyclictest181rcu_preempt07:24:352
10974998156,10cyclictest181rcu_preempt07:24:352
10974998136,8cyclictest181rcu_preempt07:29:432
10974998136,8cyclictest181rcu_preempt07:29:432
10965998151,20cyclictest19720-21latency_hist11:44:300
10965998151,20cyclictest19720-21latency_hist11:44:300
10974998053,10cyclictest181rcu_preempt09:37:012
10974998053,10cyclictest181rcu_preempt09:37:012
10974998052,17cyclictest28500-21sh11:59:292
10974998052,17cyclictest28500-21sh11:59:292
10974998036,10cyclictest181rcu_preempt09:25:522
10974998035,13cyclictest181rcu_preempt09:31:202
1097499802,51cyclictest30812-21unin-run11:09:262
10974998013,32cyclictest13725-21memory08:44:522
10970998060,14cyclictest9250-21sh10:32:241
10970998060,14cyclictest9250-21sh10:32:241
10970998029,36cyclictest26072-21modprobe07:44:251
1098099793,32cyclictest24865-21chrt10:59:283
1098099793,32cyclictest24865-21chrt10:59:283
10974997956,8cyclictest181rcu_preempt09:50:232
10974997950,20cyclictest25044-21latency09:10:222
1097499793,48cyclictest13316-21fschecks_time09:44:492
10974997934,12cyclictest181rcu_preempt10:24:482
10970997963,10cyclictest11204-21ssh11:30:271
10965997955,15cyclictest17883-21diskmemload09:24:300
1098099782,38cyclictest32138-21taskset10:15:333
1098099782,33cyclictest5426-21chrt10:25:063
1098099782,32cyclictest13986-21taskset12:29:253
10974997854,9cyclictest181rcu_preempt11:49:362
10974997849,20cyclictest26644-21sh11:01:152
10974997844,12cyclictest181rcu_preempt07:59:452
10974997844,12cyclictest181rcu_preempt07:59:452
10974997838,7cyclictest181rcu_preempt08:59:522
10974997838,7cyclictest181rcu_preempt08:59:522
10970997863,10cyclictest6853-21ssh12:16:461
10970997862,10cyclictest28386-21/usr/sbin/munin07:49:511
10970997860,11cyclictest26215-21ssh11:54:531
10970997860,11cyclictest26215-21ssh11:54:531
10965997857,15cyclictest5021-21latency_hist08:19:280
10965997841,28cyclictest26865-21kworker/u17:3+nfsiod10:55:550
10965997841,28cyclictest26865-21kworker/u17:3+nfsiod10:55:550
1098099774,52cyclictest0-21swapper/312:19:423
10974997743,10cyclictest181rcu_preempt12:20:432
10965997749,8cyclictest181rcu_preempt11:25:170
10974997629,10cyclictest181rcu_preempt08:10:032
10974997625,9cyclictest0-21swapper/210:02:012
10970997654,14cyclictest24860-21sh10:04:351
10970997653,17cyclictest7763-21fschecks_count11:24:471
1098099753,28cyclictest1403-21chrt11:14:283
1098099753,28cyclictest1403-21chrt11:14:283
10974997551,9cyclictest181rcu_preempt07:54:432
10974997551,18cyclictest10084-21sh10:34:292
10974997551,18cyclictest10084-21sh10:34:292
10974997540,12cyclictest181rcu_preempt08:19:372
10974997537,13cyclictest181rcu_preempt10:41:172
10974997534,17cyclictest181rcu_preempt07:49:572
10974997534,10cyclictest181rcu_preempt08:51:292
10974997531,13cyclictest181rcu_preempt09:17:222
1097499752,38cyclictest27771-21sort10:09:292
10974997516,24cyclictest0-21swapper/208:09:292
10970997558,11cyclictest20210-21unixbench_multi10:50:031
10970997558,11cyclictest20210-21unixbench_multi10:50:031
10970997555,14cyclictest17135-21processes08:55:171
10970997554,15cyclictest30097-21sh09:19:261
10965997553,16cyclictest24912-21fschecks_count07:39:480
10965997541,20cyclictest14028-21fschecks_time11:34:490
10965997512,33cyclictest15-21ksoftirqd/007:09:530
107442756,50sleep10-21swapper/106:58:371
10974997448,11cyclictest181rcu_preempt08:44:192
10974997441,10cyclictest181rcu_preempt11:19:522
10974997441,10cyclictest181rcu_preempt11:19:522
10974997437,12cyclictest181rcu_preempt11:59:482
10974997422,8cyclictest0-21swapper/212:24:382
10965997458,11cyclictest0-21swapper/009:54:500
10965997458,10cyclictest14058-21ssh10:40:020
10965997431,28cyclictest277-21dbus-daemon10:04:260
1096599742,53cyclictest10737-21apt-get11:29:530
1098099733,27cyclictest19658-21chrt07:24:273
10974997346,11cyclictest181rcu_preempt08:55:122
10974997331,7cyclictest181rcu_preempt08:15:012
10974997327,8cyclictest181rcu_preempt07:45:032
10974997320,13cyclictest0-21swapper/207:39:552
1097099737,25cyclictest0-21swapper/111:39:431
1097099737,25cyclictest0-21swapper/111:39:431
10970997352,14cyclictest17883-21diskmemload09:09:301
10970997321,19cyclictest17883-21diskmemload11:14:451
10970997312,21cyclictest19676-21snmpd08:14:391
1096599736,32cyclictest15-21ksoftirqd/012:01:450
10965997353,15cyclictest22935-21latency_hist07:34:280
10965997353,15cyclictest22935-21latency_hist07:34:280
1096599733,44cyclictest4074-21runrttasks12:12:190
10965997328,31cyclictest277-21dbus-daemon11:59:260
10965997328,31cyclictest277-21dbus-daemon11:59:260
1098099723,28cyclictest24259-21chrt10:03:333
1098099722,29cyclictest22068-21taskset10:54:293
1098099722,29cyclictest22068-21taskset10:54:293
10980997211,39cyclictest0-21swapper/311:45:313
10980997211,39cyclictest0-21swapper/311:45:313
10974997245,10cyclictest181rcu_preempt10:45:092
10974997231,7cyclictest181rcu_preempt07:14:582
10974997229,10cyclictest181rcu_preempt10:22:342
10974997229,10cyclictest181rcu_preempt10:22:342
10970997227,8cyclictest0-21swapper/107:37:451
10970997217,24cyclictest0-21swapper/111:04:581
10965997256,11cyclictest10952-21cyclictest10:54:270
10965997256,11cyclictest10952-21cyclictest10:54:270
10965997253,11cyclictest7217-21latency08:24:500
10965997253,11cyclictest7217-21latency08:24:500
10965997251,15cyclictest7827-21apt-key12:19:260
10965997240,22cyclictest19074-21timerandwakeup09:00:020
10965997240,22cyclictest19074-21timerandwakeup09:00:020
10965997221,21cyclictest30774-21seq07:57:370
10965997215,29cyclictest15-21ksoftirqd/010:10:140
10965997214,27cyclictest15-21ksoftirqd/009:29:560
10965997211,29cyclictest15-21ksoftirqd/011:47:100
10965997211,29cyclictest15-21ksoftirqd/011:47:100
10965997211,28cyclictest15-21ksoftirqd/007:01:000
1098099714,35cyclictest0-21swapper/309:24:453
1098099713,32cyclictest19376-21chrt09:00:153
1098099713,32cyclictest19376-21chrt09:00:153
1098099713,25cyclictest4540-21taskset11:19:353
1098099713,25cyclictest4540-21taskset11:19:353
1098099713,22cyclictest25137-21taskset10:04:463
10974997138,12cyclictest181rcu_preempt11:45:442
10974997138,12cyclictest181rcu_preempt11:45:442
10974997135,8cyclictest181rcu_preempt11:14:492
10974997132,9cyclictest0-21swapper/207:39:282
10974997122,26cyclictest0-21swapper/208:29:582
10970997149,15cyclictest1493-21latency_hist11:14:291
10970997149,15cyclictest1493-21latency_hist11:14:291
1097099714,31cyclictest22357-21systemctl11:49:251
1097099714,31cyclictest22357-21systemctl11:49:251
10965997158,9cyclictest10952-21cyclictest10:25:200
10965997157,8cyclictest25132-21sh10:04:460
10965997150,15cyclictest0-21swapper/007:39:250
10965997122,21cyclictest16827-21seq07:14:440
10965997116,23cyclictest15-21ksoftirqd/011:50:510
10965997115,35cyclictest15-21ksoftirqd/011:09:500
10965997115,35cyclictest15-21ksoftirqd/011:09:500
10965997112,28cyclictest15-21ksoftirqd/007:50:260
10965997110,29cyclictest15-21ksoftirqd/007:05:150
119932700,6sleep30-21swapper/310:36:453
1098099703,30cyclictest2070-21taskset10:19:593
1098099703,30cyclictest2070-21taskset10:19:593
1098099702,27cyclictest28106-21chrt07:49:433
10974997035,13cyclictest181rcu_preempt08:29:292
10974997035,13cyclictest181rcu_preempt08:29:292
1097099704,50cyclictest9873-21latency_hist08:34:281
10970997021,10cyclictest0-21swapper/110:28:431
10970997010,23cyclictest1599-21seq08:08:231
10965997049,14cyclictest15865-21latency_hist09:49:290
10965997037,26cyclictest0-21swapper/012:25:030
10965997035,23cyclictest16566-21ssh09:49:550
10965997016,22cyclictest15-21ksoftirqd/011:03:310
10965997013,34cyclictest15-21ksoftirqd/009:43:320
10965997013,28cyclictest15-21ksoftirqd/009:11:480
10965997010,34cyclictest15-21ksoftirqd/007:28:020
10965997010,34cyclictest15-21ksoftirqd/007:28:020
10974996944,8cyclictest181rcu_preempt07:10:022
10970996951,11cyclictest32358-21kworker/u17:0-nfsiod09:27:441
10970996949,14cyclictest20642-21threads07:25:001
10970996949,14cyclictest20642-21threads07:25:001
10970996939,21cyclictest4606-21sort09:29:531
1097099693,49cyclictest11624-21latency_hist08:39:291
10970996927,33cyclictest0-21swapper/108:24:471
10970996927,33cyclictest0-21swapper/108:24:471
10965996948,9cyclictest0-21swapper/011:19:270
1098099682,35cyclictest0-21swapper/311:29:433
10974996829,9cyclictest181rcu_preempt11:40:482
10974996829,9cyclictest181rcu_preempt11:40:482
1097099687,28cyclictest9795-21seq12:21:031
1097099686,30cyclictest352-21runrttasks08:19:411
10970996850,12cyclictest1-21systemd10:13:141
10970996846,16cyclictest24822-21munin-plugin-st10:59:281
10970996846,16cyclictest24822-21munin-plugin-st10:59:281
10970996837,24cyclictest30534-21kworker/u18:3+nfsiod10:38:131
10970996811,20cyclictest26818-21seq11:01:441
10970996811,20cyclictest17883-21diskmemload11:36:561
1096599689,34cyclictest15-21ksoftirqd/008:05:490
10965996855,7cyclictest0-21swapper/011:24:130
10965996855,7cyclictest0-21swapper/011:24:130
1096599685,33cyclictest15-21ksoftirqd/008:47:320
10965996847,15cyclictest298-21in:imuxsock09:16:150
10965996847,11cyclictest0-21swapper/010:32:510
10965996847,11cyclictest0-21swapper/010:32:510
1096599684,30cyclictest10796-21memory10:34:520
10965996841,20cyclictest17883-21diskmemload09:35:000
10965996841,20cyclictest17883-21diskmemload09:35:000
1097099675,27cyclictest352-21runrttasks10:02:081
1097099672,35cyclictest18327-21cstates08:59:441
1097099672,35cyclictest18327-21cstates08:59:441
10970996716,17cyclictest17883-21diskmemload12:27:411
10970996716,16cyclictest10251-21ssh09:39:461
10965996754,9cyclictest10952-21cyclictest08:29:580
10965996752,10cyclictest2575-21processes08:09:590
10965996747,14cyclictest18487-21fschecks_count07:19:470
10965996747,13cyclictest0-21swapper/010:24:290
10965996747,13cyclictest0-21swapper/010:24:290
1096599672,35cyclictest15-21ksoftirqd/010:47:230
10965996710,26cyclictest21171-21ssh09:04:360
1098099664,28cyclictest4830-21chrt12:14:253
1097099669,21cyclictest14739-21ssh09:46:511
1097099667,28cyclictest16394-21taskset10:44:441
1097099667,22cyclictest17780-21seq07:16:341
1097099664,43cyclictest16299-21latency_hist08:54:281
10965996618,28cyclictest15-21ksoftirqd/008:01:010
10965996618,28cyclictest15-21ksoftirqd/008:01:010
1098099652,28cyclictest3844-21taskset11:18:173
1098099652,25cyclictest29182-21chrt10:10:343
10970996544,14cyclictest23711-21unixbench_multi11:50:041
1097099653,46cyclictest16396-21modprobe07:14:261
1097099653,45cyclictest19570-21ntp_kernel_pll_09:54:571
1097099653,39cyclictest27196-21latency_hist09:14:291
10970996522,9cyclictest0-21swapper/106:59:451
10965996551,8cyclictest31831-21cat10:15:020
10965996547,8cyclictest0-21swapper/009:28:150
10965996547,11cyclictest11064-21sshd08:35:160
1098099643,25cyclictest30294-21chrt09:19:293
1098099643,25cyclictest0-21swapper/307:19:263
1097099648,22cyclictest8944-21seq09:37:141
1097099648,22cyclictest8944-21seq09:37:141
1097099645,27cyclictest30601-21/usr/sbin/munin09:19:471
10970996436,21cyclictest19593-21kworker/u18:2+nfsiod10:15:041
1097099643,50cyclictest4585-21ssh11:19:391
1097099643,50cyclictest4585-21ssh11:19:391
1097099643,48cyclictest352-21runrttasks09:49:351
1097099643,46cyclictest26327-21/usr/sbin/munin07:45:001
1097099642,42cyclictest3285-21ssh12:10:061
10970996421,8cyclictest0-21swapper/110:40:121
10970996417,17cyclictest0-21swapper/107:19:571
10970996410,19cyclictest560-21seq12:05:541
10970996410,19cyclictest560-21seq12:05:541
1098099634,18cyclictest0-21swapper/307:44:263
10970996346,11cyclictest297-21systemd-logind12:04:261
1097099632,47cyclictest32051-21timerwakeupswit07:59:591
1097099632,47cyclictest32051-21timerwakeupswit07:59:591
10970996321,7cyclictest0-21swapper/107:04:341
1098099624,24cyclictest0-21swapper/310:34:263
1098099624,24cyclictest0-21swapper/310:34:263
1097099627,19cyclictest14364-21seq08:46:181
10970996241,15cyclictest2485-21ntp_kernel_pll_08:09:551
1096599625,35cyclictest15-21ksoftirqd/008:23:430
10965996241,14cyclictest352-21runrttasks08:49:350
10980996112,12cyclictest0-21swapper/308:04:273
10980996112,12cyclictest0-21swapper/308:04:273
1097099613,39cyclictest22040-21ntp_kernel_pll_07:29:551
1097099613,39cyclictest22040-21ntp_kernel_pll_07:29:551
10970996120,10cyclictest0-21swapper/110:21:561
10970996120,10cyclictest0-21swapper/110:21:561
10965996146,8cyclictest0-21swapper/008:55:070
1098099603,40cyclictest19080-21chrt09:54:453
1097099603,36cyclictest12242-21ps08:39:581
1098099599,37cyclictest0-21swapper/309:09:493
1097099591,34cyclictest0-21swapper/107:54:491
952425812,28sleep30-21swapper/306:55:043
1098099584,34cyclictest13318-21chrt07:04:383
10980995812,17cyclictest0-21swapper/312:19:303
1098099572,37cyclictest28774-21chrt11:05:003
1098099566,15cyclictest0-21swapper/310:44:473
1098099563,37cyclictest23368-21chrt07:34:483
1098099563,35cyclictest22918-21taskset11:49:483
1098099562,39cyclictest14926-21taskset10:41:403
1098099562,35cyclictest18782-21chrt09:54:283
1098099553,35cyclictest10227-21chrt09:39:443
1098099542,38cyclictest20659-21chrt07:25:003
1098099542,38cyclictest20659-21chrt07:25:003
1098099542,36cyclictest6240-21taskset09:32:593
1098099542,36cyclictest1533-21chrt12:08:373
1098099542,36cyclictest1533-21chrt12:08:373
1098099533,36cyclictest3762-21chrt08:14:463
1098099533,33cyclictest15612-21taskset07:09:573
1098099533,26cyclictest2068-1kworker/3:1H+kblockd08:19:443
1098099532,37cyclictest30678-21taskset12:02:413
1098099524,36cyclictest7423-21chrt09:34:503
1098099524,36cyclictest7423-21chrt09:34:503
1098099523,35cyclictest21711-21chrt09:04:533
1098099523,35cyclictest12141-21chrt08:39:533
1098099523,32cyclictest13447-21chrt08:44:473
1098099522,37cyclictest16128-21chrt11:38:453
1098099522,37cyclictest15116-21chrt09:47:563
1098099513,33cyclictest9944-21chrt11:28:473
1098099513,31cyclictest8433-21taskset08:29:363
1098099512,34cyclictest6921-21chrt08:24:423
1098099512,34cyclictest6921-21chrt08:24:423
1098099512,32cyclictest26482-21chrt07:44:443
1098099503,34cyclictest16855-21chrt08:55:083
1098099503,33cyclictest2633-21chrt08:10:003
1098099503,31cyclictest17941-21chrt11:40:273
1098099503,31cyclictest17941-21chrt11:40:273
1098099482,32cyclictest31934-21chrt09:21:203
1098099454,31cyclictest22404-21taskset07:30:023
1098099454,31cyclictest22404-21taskset07:30:023
1098099443,30cyclictest12855-21taskset07:04:303
1098099432,30cyclictest29739-21taskset07:54:453
10980994312,15cyclictest0-21swapper/308:09:293
1098099393,25cyclictest15961-21taskset08:50:433
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional