You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-13 - 06:27
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot7.osadl.org (updated Mon Jul 13, 2026 00:44:34)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
19879991243,89cyclictest20371-21apt-get00:22:281
281562990,8sleep128155-21ssh21:52:251
19879999851,42cyclictest19859-21cyclictest22:07:301
19879999840,12cyclictest0-21swapper/100:02:321
19879999840,12cyclictest0-21swapper/100:02:321
1970229610,54sleep119735-21munin-run18:57:091
189322969,61sleep218951-21proc_pri18:52:502
19879999530,13cyclictest0-21swapper/119:47:081
19879999468,19cyclictest0-21swapper/120:03:181
19879999468,19cyclictest0-21swapper/120:03:181
19879999442,14cyclictest24463-21latency_hist21:47:121
19879999435,12cyclictest0-21swapper/119:02:121
1987999923,31cyclictest29971-21latency_hist21:02:111
19868999273,13cyclictest23379-21mailstats22:37:420
19879999040,12cyclictest1762-21latency_hist22:57:111
19879999040,12cyclictest1762-21latency_hist22:57:111
1987999902,28cyclictest27341-21sshd22:44:341
1987999902,28cyclictest27341-21sshd22:44:341
19879998963,17cyclictest20692-21mailstats18:57:431
19879998933,12cyclictest0-21swapper/123:29:321
19879998933,12cyclictest0-21swapper/123:29:321
1987999882,33cyclictest8171-21ntp_states22:12:371
1987999882,33cyclictest8171-21ntp_states22:12:371
19868998851,8cyclictest181rcu_preempt23:44:240
19868998851,8cyclictest181rcu_preempt23:44:240
19879998728,12cyclictest0-21swapper/121:57:331
19868998666,14cyclictest25729-21fschecks_count21:48:460
19868998666,13cyclictest20444-21latency_hist20:37:110
19879998561,18cyclictest31623-21latency_hist23:47:121
19879998561,18cyclictest31623-21latency_hist23:47:121
19868998551,27cyclictest1-21systemd21:55:570
19887998469,8cyclictest0-21swapper/200:17:082
19887998362,13cyclictest31478-40logrotate23:47:102
19887998362,13cyclictest31478-40logrotate23:47:102
19887998353,8cyclictest181rcu_preempt21:32:252
19887998245,7cyclictest181rcu_preempt19:52:322
19868998264,12cyclictest277-21dbus-daemon00:22:090
19879998062,13cyclictest22486-21latency19:02:371
1987999803,28cyclictest10246-21apt-get22:17:241
19868998065,11cyclictest19859-21cyclictest22:55:150
19868998065,11cyclictest19859-21cyclictest22:55:150
1988799792,59cyclictest25210-21sh21:47:482
19879997962,11cyclictest23578-21systemd-run20:47:101
170212793,21sleep017076-21modprobe20:27:090
19887997860,13cyclictest300-21rs:main2
19887997841,8cyclictest181rcu_preempt21:57:272
1987999786,55cyclictest25036-21apt-get21:48:011
19868997861,11cyclictest21628-21munin-node00:12:420
19887997758,11cyclictest22318-21modprobe22:37:082
19887997758,11cyclictest22318-21modprobe22:37:082
19868997762,11cyclictest19859-21cyclictest20:06:260
19868997762,11cyclictest19859-21cyclictest20:06:260
19868997756,14cyclictest20538-21threads22:32:440
19868997756,14cyclictest20538-21threads22:32:440
19879997653,15cyclictest170-21jbd2/mmcblk2p2-823:47:561
19868997663,9cyclictest19859-21cyclictest19:39:450
1989699753,32cyclictest31114-21taskset23:46:133
1989699753,32cyclictest31114-21taskset23:46:133
1989699753,30cyclictest10247-21chrt22:17:083
1989699753,30cyclictest10247-21chrt22:17:083
1986899758,33cyclictest15-21ksoftirqd/023:22:240
19868997560,10cyclictest19859-21cyclictest00:05:180
19868997560,10cyclictest19859-21cyclictest00:05:180
19868997559,9cyclictest16747-21ssh22:27:250
19868997557,13cyclictest26983-21diskmemload23:17:270
19868997557,13cyclictest26983-21diskmemload23:17:270
19868997556,13cyclictest352-21runrttasks20:37:370
19868997554,14cyclictest26783-21latency_hist19:17:110
19868997530,15cyclictest15-21ksoftirqd/021:42:230
221392740,11sleep2371rcuc/219:02:282
1989699743,33cyclictest14270-21chrt20:17:313
19887997456,12cyclictest30276-21/usr/sbin/munin21:02:462
19879997456,9cyclictest0-21swapper/122:47:441
19879997455,13cyclictest2787-21processes22:57:431
19868997460,10cyclictest19859-21cyclictest22:07:380
19868997459,11cyclictest58-21kcompactd019:34:450
19868997456,14cyclictest19859-21cyclictest20:52:310
19868997455,10cyclictest3714-21ssh21:12:120
19868997446,19cyclictest23489-21modprobe20:47:080
19887997351,13cyclictest0-21swapper/220:27:082
19879997355,12cyclictest3533-21cut21:12:101
19879997353,13cyclictest22103-21kworker/u17:3-rpciod22:37:321
19879997342,10cyclictest181rcu_preempt00:08:381
1987999732,32cyclictest32535-21grep19:32:431
19868997358,9cyclictest14236-21rm22:22:360
19868997358,9cyclictest14236-21rm22:22:360
19868997348,17cyclictest8072-21latency_hist00:02:110
19868997342,26cyclictest0-21swapper/000:23:280
19887997252,14cyclictest8403-21switchtime22:12:422
19887997252,14cyclictest8403-21switchtime22:12:422
19887997252,13cyclictest28360-21kworker/u17:3-rpciod00:02:312
19887997252,13cyclictest28360-21kworker/u17:3-rpciod00:02:312
19887997234,7cyclictest181rcu_preempt19:42:322
19879997253,13cyclictest14192-21acpi00:12:191
19868997259,9cyclictest58-21kcompactd020:14:100
19868997259,9cyclictest58-21kcompactd020:11:130
19868997259,9cyclictest58-21kcompactd020:11:130
19868997259,9cyclictest58-21kcompactd019:48:550
19868997256,10cyclictest5004-21ssh23:02:150
19868997256,10cyclictest5004-21ssh23:02:150
1986899723,59cyclictest2295-21/usr/sbin/munin23:52:330
107152722,7sleep00-21swapper/022:17:150
19887997154,10cyclictest20720-21kworker/u17:3-rpciod21:52:462
19887997150,15cyclictest8841-21apt-key20:02:112
19887997138,18cyclictest352-21runrttasks23:52:562
19879997139,22cyclictest23704-21switchtime23:32:431
1987999712,49cyclictest27083-21diskstats19:17:281
19879997124,28cyclictest29923-21kworker/u19:0-events_unbound19:47:221
19879997122,25cyclictest15423-21modprobe20:22:081
19868997155,10cyclictest8857-21dpkg20:02:100
19868997129,18cyclictest181rcu_preempt19:10:350
1989699703,29cyclictest27663-21chrt20:57:333
1989699703,29cyclictest11279-21taskset00:07:243
1989699702,34cyclictest22659-21chrt00:26:173
19887997033,28cyclictest32224-21kworker/u19:0+nfsiod21:09:592
19887997025,22cyclictest0-21swapper/223:22:092
19887997025,22cyclictest0-21swapper/223:22:092
19879997054,9cyclictest0-21swapper/100:22:121
19879997048,16cyclictest6878-21cpu21:17:251
19879997035,8cyclictest181rcu_preempt21:22:201
19879997032,8cyclictest181rcu_preempt19:22:451
19879997032,8cyclictest181rcu_preempt19:22:451
1987999702,30cyclictest30491-21taskset19:27:331
1987999702,30cyclictest30491-21taskset19:27:331
19868997057,9cyclictest58-21kcompactd021:15:370
19868997056,9cyclictest58-21kcompactd019:53:090
19868997054,10cyclictest26983-21diskmemload00:07:300
19868997051,13cyclictest29971-21latency_hist21:02:110
1986899704,56cyclictest13402-21ssh21:27:380
1986899704,56cyclictest13402-21ssh21:27:380
1989699692,21cyclictest23832-21taskset20:47:123
19887996953,12cyclictest19859-21cyclictest23:28:442
19887996953,12cyclictest19859-21cyclictest23:28:442
19887996945,15cyclictest11381-21ntp_kernel_pll_20:07:372
19887996945,15cyclictest11381-21ntp_kernel_pll_20:07:372
19887996931,8cyclictest181rcu_preempt23:02:102
19887996930,9cyclictest181rcu_preempt18:57:312
19887996930,9cyclictest181rcu_preempt18:57:312
19879996932,8cyclictest181rcu_preempt22:33:311
19879996932,8cyclictest181rcu_preempt22:33:311
1987999692,23cyclictest24928-21timerwakeupswit20:48:211
19879996911,40cyclictest17174-21kworker/u17:1+xprtiod21:38:101
19879996911,40cyclictest17174-21kworker/u17:1+xprtiod21:38:101
19868996950,12cyclictest18270-21unixbench_singl20:27:470
19868996950,12cyclictest18270-21unixbench_singl20:27:470
19868996948,7cyclictest181rcu_preempt23:11:570
19868996946,19cyclictest19859-21cyclictest23:12:120
1986899693,35cyclictest352-21runrttasks18:57:270
1986899693,35cyclictest352-21runrttasks18:57:270
1989699683,24cyclictest6307-21chrt19:52:393
1989699683,23cyclictest27026-21taskset22:43:403
1989699683,23cyclictest27026-21taskset22:43:403
1989699682,28cyclictest3853-21chrt22:59:403
1989699682,25cyclictest8595-21taskset21:19:393
1989699682,24cyclictest2398-21chrt23:52:253
1989699682,21cyclictest10900-21chrt00:07:083
1989699682,21cyclictest10900-21chrt00:07:083
19887996850,13cyclictest27281-21kernelversion19:17:332
19887996850,13cyclictest19859-21cyclictest20:42:102
19887996848,14cyclictest21929-21cstates21:42:272
19887996847,15cyclictest16922-21sh22:27:302
19887996841,20cyclictest18785-21kworker/u19:1+nfsiod23:50:392
19887996835,8cyclictest181rcu_preempt00:07:512
1988799682,45cyclictest24022-21apt-get20:47:362
19879996848,12cyclictest0-21swapper/122:03:161
19879996845,13cyclictest0-21swapper/120:02:091
1987999684,33cyclictest15805-21apt-get21:32:191
19879996837,8cyclictest181rcu_preempt23:02:201
19879996837,8cyclictest181rcu_preempt23:02:201
1987999683,31cyclictest15885-21fschecks_count20:22:301
19868996853,9cyclictest3463-21ssh22:04:580
19868996853,10cyclictest26983-21diskmemload21:17:140
19868996853,10cyclictest19859-21cyclictest19:25:040
19868996853,10cyclictest19859-21cyclictest19:25:040
1986899683,41cyclictest517-21unixbench_multi23:48:120
1989699673,24cyclictest4699-21chrt19:47:373
1989699673,23cyclictest31051-21chrt21:57:223
1989699672,23cyclictest21831-21chrt23:30:043
1989699672,23cyclictest21831-21chrt23:30:043
1989699672,22cyclictest17356-21taskset20:27:273
19887996751,10cyclictest12814-21sh22:20:272
19887996745,16cyclictest6110-21unixbench_singl23:02:472
19887996745,16cyclictest6110-21unixbench_singl23:02:472
19887996745,16cyclictest27940-21sh20:57:422
19887996733,26cyclictest3034-21kworker/u19:2+nfsiod22:47:432
19887996728,30cyclictest20318-21munin-run20:37:092
19879996748,12cyclictest0-21swapper/120:52:471
19879996747,14cyclictest12834-21kernelversion20:12:331
19879996746,13cyclictest8542-21kworker/u17:1+events_unbound21:07:101
19879996710,14cyclictest18844-21latency_hist20:32:111
19879996710,14cyclictest18844-21latency_hist20:32:111
1986899675,52cyclictest2421-21idleruntime22:57:330
19868996750,11cyclictest3890-21systemctl19:47:080
1986899674,34cyclictest10240-21cron22:17:080
1986899674,34cyclictest10240-21cron22:17:080
1986899673,36cyclictest16005-21diskstats21:32:290
1986899673,25cyclictest29061-21runrttasks22:47:350
1989699665,39cyclictest0-21swapper/322:17:293
1989699663,24cyclictest14772-21chrt21:30:093
1989699663,24cyclictest14772-21chrt21:30:093
1989699663,22cyclictest12295-21chrt23:13:183
1989699662,25cyclictest24306-21taskset23:33:403
1989699662,22cyclictest23489-21chrt19:07:103
1989699662,22cyclictest21280-21chrt22:34:113
1989699662,22cyclictest21280-21chrt22:34:113
19887996650,9cyclictest20834-21ssh21:40:212
19887996650,9cyclictest20834-21ssh21:40:212
19887996649,11cyclictest4145-21/usr/sbin/munin19:47:422
19887996648,12cyclictest26983-21diskmemload21:23:372
19887996642,17cyclictest19676-21snmpd22:37:302
19879996652,10cyclictest19859-21cyclictest20:32:381
19879996650,12cyclictest19859-21cyclictest23:52:251
19879996636,23cyclictest0-21swapper/119:57:091
1987999662,30cyclictest13806-21sed21:27:461
1987999662,30cyclictest13806-21sed21:27:461
19879996622,31cyclictest21778-21sshd20:40:531
19868996649,10cyclictest25292-21rm23:36:300
19868996637,21cyclictest0-21swapper/022:46:380
19868996637,21cyclictest0-21swapper/022:46:380
183912669,36sleep018394-21grep18:52:270
1989699653,22cyclictest25985-21chrt20:52:353
1989699653,22cyclictest25665-21chrt19:12:333
1989699653,22cyclictest11248-21taskset20:07:343
1989699653,22cyclictest11248-21taskset20:07:343
1989699653,21cyclictest20120-21chrt00:22:113
1989699653,19cyclictest18702-21chrt20:32:093
1989699653,19cyclictest18702-21chrt20:32:093
19887996550,9cyclictest2836-21ssh22:03:142
19887996549,11cyclictest6188-21/usr/sbin/munin23:57:452
19887996549,10cyclictest12780-21runrttasks21:27:142
19887996549,10cyclictest12780-21runrttasks21:27:142
19887996549,10cyclictest11735-21mailstats23:12:422
19887996548,10cyclictest5205-21ssh22:07:402
19887996543,15cyclictest23694-21switchtime23:32:432
19887996539,8cyclictest181rcu_preempt19:22:372
19887996539,8cyclictest181rcu_preempt19:22:372
19887996539,16cyclictest26036-21runrttasks22:42:342
19887996539,16cyclictest26036-21runrttasks22:42:342
19879996547,12cyclictest8245-21entropy23:07:291
19879996543,12cyclictest26983-21diskmemload23:25:161
1987999653,37cyclictest1253-21if_eth019:37:331
19879996519,25cyclictest26983-21diskmemload22:30:121
19879996512,9cyclictest26903-21head23:37:451
19868996539,19cyclictest10703-21kworker/u17:2+nfsiod23:29:500
19868996539,19cyclictest10703-21kworker/u17:2+nfsiod23:29:500
19868996538,20cyclictest21795-21kworker/u17:3+nfsiod21:04:210
19868996538,20cyclictest0-21swapper/021:38:540
19868996538,20cyclictest0-21swapper/021:38:540
19868996536,20cyclictest22291-21tune2fs19:02:330
1986899653,34cyclictest30150-21/usr/sbin/munin19:27:410
1986899653,34cyclictest30150-21/usr/sbin/munin19:27:410
1986899652,35cyclictest26147-21fschecks_time23:37:300
1989699645,29cyclictest0-21swapper/320:47:363
1989699643,28cyclictest8215-21taskset23:07:263
1989699643,26cyclictest31349-21chrt22:52:103
1989699643,25cyclictest2574-21chrt21:09:293
1989699642,25cyclictest20942-21taskset21:40:393
1989699642,25cyclictest20942-21taskset21:40:393
1989699642,22cyclictest9304-21chrt20:03:133
1989699642,22cyclictest9304-21chrt20:03:133
1989699642,22cyclictest16442-21chrt22:27:103
1989699642,22cyclictest16442-21chrt22:27:103
19887996449,8cyclictest0-21swapper/220:12:302
19887996437,14cyclictest0-21swapper/220:32:112
19887996437,14cyclictest0-21swapper/220:32:112
19887996435,7cyclictest181rcu_preempt22:52:442
19887996435,7cyclictest181rcu_preempt22:52:442
19887996434,7cyclictest181rcu_preempt20:17:332
19887996426,20cyclictest4652-21grep21:12:452
19879996445,14cyclictest5587-21fschecks_time23:57:321
1987999644,35cyclictest11003-21apt23:12:191
1987999642,35cyclictest26983-21diskmemload21:14:531
1987999642,32cyclictest26254-21grep19:12:451
1986899645,47cyclictest12490-21latency_hist21:27:120
1986899643,33cyclictest352-21runrttasks21:59:420
1989699634,22cyclictest27434-21chrt21:51:223
1989699633,26cyclictest24038-21taskset21:45:583
1989699633,24cyclictest4356-21chrt22:07:113
1989699633,23cyclictest21553-21chrt20:37:563
1989699633,22cyclictest7693-21chrt19:57:343
1989699633,22cyclictest6274-21chrt23:03:093
1989699633,22cyclictest6274-21chrt23:03:093
1989699633,22cyclictest27421-21chrt23:39:073
1989699633,22cyclictest17140-21chrt23:22:303
1989699633,21cyclictest19383-21chrt22:32:093
1989699632,24cyclictest6465-21chrt21:17:033
1989699632,22cyclictest30817-21chrt21:02:363
19887996343,14cyclictest9443-21sh20:03:182
19887996343,14cyclictest9443-21sh20:03:182
19879996338,16cyclictest16563-21ssh22:27:121
19879996338,16cyclictest16563-21ssh22:27:121
19868996333,21cyclictest14668-21grep20:17:420
1989699623,23cyclictest31369-21chrt19:30:323
1989699623,23cyclictest31369-21chrt19:30:323
1989699622,27cyclictest20663-21chrt18:57:433
1989699622,27cyclictest20663-21chrt18:57:433
1989699622,24cyclictest9789-21taskset21:22:183
1989699622,24cyclictest29661-21chrt21:54:143
1989699622,22cyclictest24245-21taskset19:07:393
1989699622,22cyclictest16328-21chrt21:32:363
1989699622,21cyclictest892-21chrt19:37:123
19887996247,8cyclictest0-21swapper/223:22:472
19887996247,10cyclictest58-21kcompactd022:23:202
19887996247,10cyclictest58-21kcompactd022:23:202
19887996245,9cyclictest0-21swapper/220:47:122
19887996239,7cyclictest181rcu_preempt19:37:222
19879996227,12cyclictest181rcu_preempt20:09:541
19879996227,12cyclictest181rcu_preempt20:09:541
1986899624,32cyclictest352-21runrttasks20:48:140
1989699613,21cyclictest24763-21chrt22:40:403
1989699613,20cyclictest27990-21chrt19:18:453
1989699613,20cyclictest20462-21chrt20:37:113
19896996111,12cyclictest0-21swapper/319:37:083
19887996144,13cyclictest19859-21cyclictest19:32:182
19887996144,11cyclictest30340-21fschecks_count19:27:312
19887996144,11cyclictest30340-21fschecks_count19:27:312
19887996144,10cyclictest0-21swapper/223:37:302
19887996144,10cyclictest0-21swapper/221:17:482
19887996137,16cyclictest0-21swapper/200:17:352
19887996137,11cyclictest0-21swapper/219:12:112
1987999612,36cyclictest26983-21diskmemload23:17:191
1987999612,36cyclictest26983-21diskmemload23:17:191
1986899614,38cyclictest27076-21df_inode19:17:270
1975826112,28sleep30-21swapper/318:57:113
1989699603,23cyclictest15948-21chrt00:14:383
1989699602,21cyclictest16563-21chrt23:22:013
1989699602,21cyclictest16563-21chrt23:22:013
1988799604,10cyclictest181rcu_preempt23:07:312
1988799603,26cyclictest26111-21timerandwakeup19:12:442
1989699593,24cyclictest5728-21chrt22:07:523
1989699592,24cyclictest2691-21taskset19:42:313
1989699592,22cyclictest7280-21chrt00:00:193
1989699582,22cyclictest13876-21taskset20:17:103
19887995836,13cyclictest0-21swapper/220:57:082
1989699578,15cyclictest0-21swapper/323:47:563
1989699572,23cyclictest1013-21taskset22:55:023
1989699572,23cyclictest1013-21taskset22:55:023
19879995736,14cyclictest58-21kcompactd019:07:261
1989699513,31cyclictest29999-21chrt19:27:113
1989699513,31cyclictest29999-21chrt19:27:113
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional