You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-20 - 12:00
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Wed May 20, 2026 00:44:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
581421127,16sleep00-21swapper/018:57:240
62319910452,22cyclictest6216-21cyclictest21:29:221
62369910258,13cyclictest181rcu_preempt00:26:092
62319910120,39cyclictest31-21ksoftirqd/122:26:171
62269910014,56cyclictest14153-21ssh22:49:330
6236999766,8cyclictest181rcu_preempt22:43:352
6236999663,9cyclictest181rcu_preempt19:55:512
6231999559,11cyclictest181rcu_preempt22:50:161
6231999460,8cyclictest181rcu_preempt19:01:241
6236999361,12cyclictest181rcu_preempt23:01:552
6236999361,12cyclictest181rcu_preempt23:01:552
176752930,7sleep20-21swapper/223:49:292
176752930,7sleep20-21swapper/223:49:292
6236999175,10cyclictest20168-21kworker/u17:2-rpciod00:21:162
6236999175,10cyclictest20168-21kworker/u17:2-rpciod00:21:162
6236999050,15cyclictest181rcu_preempt20:05:532
623699902,50cyclictest39-21ksoftirqd/223:20:522
6231999059,9cyclictest181rcu_preempt23:09:241
6231999051,11cyclictest181rcu_preempt20:11:371
622699909,28cyclictest12546-21apt23:40:590
6226999024,29cyclictest0-21swapper/023:28:500
6236998940,16cyclictest181rcu_preempt20:26:482
6236998940,16cyclictest181rcu_preempt20:26:482
6231998969,14cyclictest0-21swapper/119:21:221
623199896,49cyclictest31-21ksoftirqd/121:46:051
623199896,49cyclictest31-21ksoftirqd/121:46:051
6226998821,39cyclictest0-21swapper/021:11:240
6236998762,8cyclictest181rcu_preempt00:15:132
6236998741,13cyclictest181rcu_preempt21:16:072
6231998750,9cyclictest181rcu_preempt21:15:351
6231998734,24cyclictest58-21kcompactd023:56:001
6231998734,24cyclictest58-21kcompactd023:56:001
6231998666,7cyclictest181rcu_preempt22:31:581
6231998663,12cyclictest0-21swapper/122:21:101
6231998652,7cyclictest181rcu_preempt19:50:531
6231998645,10cyclictest6216-21cyclictest19:12:461
6231998644,9cyclictest0-21swapper/119:56:071
6236998559,9cyclictest181rcu_preempt22:06:292
623699853,65cyclictest3067-21apt-get22:31:152
6231998563,16cyclictest12795-21sh23:41:111
6226998570,10cyclictest9778-21cron19:10:490
6236998453,8cyclictest181rcu_preempt19:19:142
6236998450,9cyclictest181rcu_preempt22:11:122
6236998448,10cyclictest181rcu_preempt22:16:122
623699843,44cyclictest29930-21apt-get20:11:162
6231998457,13cyclictest181rcu_preempt21:01:061
6231998457,13cyclictest181rcu_preempt21:01:061
6231998451,14cyclictest181rcu_preempt20:16:221
6236998353,11cyclictest181rcu_preempt20:07:492
6236998351,7cyclictest181rcu_preempt23:26:252
6236998334,13cyclictest18730-21fschecks_count23:51:122
623199839,34cyclictest31-21ksoftirqd/123:21:201
6231998345,7cyclictest181rcu_preempt21:35:511
6236998260,14cyclictest2374-21systemd-journal21:37:432
6236998260,14cyclictest2374-21systemd-journal21:37:432
6236998256,18cyclictest9164-21apt-key23:35:512
6236998256,18cyclictest9164-21apt-key23:35:512
6236998254,8cyclictest181rcu_preempt21:12:242
6236998248,12cyclictest181rcu_preempt21:26:282
6231998228,11cyclictest0-21swapper/100:14:591
622699825,44cyclictest18488-21/usr/sbin/munin23:51:010
6226998210,31cyclictest0-21swapper/023:01:520
6226998210,31cyclictest0-21swapper/023:01:520
6236998158,14cyclictest11607-21sh21:51:132
6236998158,14cyclictest11607-21sh21:51:132
6236998134,12cyclictest0-21swapper/220:43:012
6231998148,8cyclictest181rcu_preempt21:51:201
6231998148,8cyclictest181rcu_preempt21:51:201
6226998168,9cyclictest6216-21cyclictest00:15:140
6236998057,7cyclictest181rcu_preempt20:51:162
6236998055,7cyclictest181rcu_preempt19:50:492
623699803,40cyclictest9590-21apt-get23:36:202
6236998028,27cyclictest0-21swapper/219:25:522
6231998063,11cyclictest9456-21munin-run00:30:481
6231998057,7cyclictest181rcu_preempt21:06:141
6231998054,9cyclictest181rcu_preempt23:32:151
6231998054,9cyclictest181rcu_preempt23:32:151
6231998050,13cyclictest181rcu_preempt21:36:141
6231998050,13cyclictest181rcu_preempt21:36:141
6231998048,15cyclictest181rcu_preempt00:05:321
6231998048,12cyclictest181rcu_preempt20:31:061
6231998047,9cyclictest181rcu_preempt19:31:061
6231998047,9cyclictest181rcu_preempt19:31:061
6231998045,7cyclictest181rcu_preempt23:27:291
6231998029,11cyclictest0-21swapper/120:55:311
6231998013,42cyclictest31-21ksoftirqd/121:16:251
6226998059,15cyclictest12292-21sh21:51:280
6226998059,15cyclictest12292-21sh21:51:280
6226998020,30cyclictest11976-21ls19:16:120
6226998018,53cyclictest8998-21apt-get20:46:040
6236997958,8cyclictest181rcu_preempt19:06:012
6236997949,12cyclictest181rcu_preempt20:31:122
6236997946,8cyclictest181rcu_preempt22:48:472
6231997953,7cyclictest181rcu_preempt22:53:461
6231997946,8cyclictest181rcu_preempt21:41:111
6231997946,8cyclictest181rcu_preempt00:06:061
6226997959,15cyclictest6199-21sh00:25:030
6226997959,15cyclictest6199-21sh00:25:030
622699795,39cyclictest5089-21rm22:33:590
6226997928,37cyclictest23229-21apt-get19:51:010
6226997917,29cyclictest24717-21wc23:06:240
6226997916,24cyclictest26993-21ssh21:21:280
6226997913,28cyclictest352-21runrttasks22:09:120
6236997854,11cyclictest181rcu_preempt19:05:342
6236997853,8cyclictest181rcu_preempt20:46:052
6236997847,7cyclictest181rcu_preempt23:09:202
6236997826,12cyclictest0-21swapper/222:37:112
6231997861,11cyclictest10094-21ssh23:37:021
6231997857,7cyclictest181rcu_preempt19:06:291
6231997847,8cyclictest181rcu_preempt19:40:521
6231997847,8cyclictest181rcu_preempt19:40:521
6231997827,14cyclictest0-21swapper/122:08:391
6226997858,14cyclictest25426-21processes19:56:220
6226997857,10cyclictest29930-21apt-get20:11:130
6226997836,29cyclictest0-21swapper/020:36:000
6226997820,22cyclictest0-21swapper/019:21:210
6226997813,25cyclictest15675-21taskset19:26:190
6226997813,25cyclictest15675-21taskset19:26:190
6226997811,27cyclictest0-21swapper/021:41:230
6236997748,21cyclictest8679-21fschecks_time21:46:112
6236997748,21cyclictest8679-21fschecks_time21:46:112
6236997746,7cyclictest181rcu_preempt22:26:062
6236997746,12cyclictest181rcu_preempt23:41:052
6236997743,13cyclictest181rcu_preempt23:58:552
6236997743,13cyclictest181rcu_preempt23:58:552
6236997742,8cyclictest181rcu_preempt19:31:092
6236997742,8cyclictest181rcu_preempt19:31:092
6236997726,7cyclictest181rcu_preempt00:09:042
6231997747,8cyclictest181rcu_preempt22:42:081
6231997742,8cyclictest181rcu_preempt19:47:261
6231997740,8cyclictest181rcu_preempt19:26:091
6231997740,8cyclictest181rcu_preempt19:26:091
6231997737,10cyclictest181rcu_preempt23:01:521
6231997737,10cyclictest181rcu_preempt23:01:521
623199773,34cyclictest31-21ksoftirqd/121:21:041
622699778,28cyclictest24978-21/usr/sbin/munin00:01:180
622699777,36cyclictest15853-21rm21:03:460
622699777,36cyclictest15853-21rm21:03:460
622699777,35cyclictest2137-21latency_hist21:35:510
622699776,38cyclictest9615-21ntp_states22:41:190
6226997759,12cyclictest3586-21ssh00:20:510
622699774,39cyclictest15946-21latency23:46:120
622699774,39cyclictest15946-21latency23:46:120
622699774,36cyclictest0-21swapper/019:46:160
6226997729,28cyclictest8276-21rm23:33:400
6226997729,28cyclictest8276-21rm23:33:400
6226997715,27cyclictest29942-21ntp_states22:21:200
6226997711,28cyclictest7866-21kworker/u17:2+xprtiod22:55:010
6236997657,12cyclictest17930-21sh22:56:052
6236997657,12cyclictest17930-21sh22:56:052
6236997652,8cyclictest181rcu_preempt19:26:232
6236997652,8cyclictest181rcu_preempt19:26:232
6236997650,7cyclictest181rcu_preempt23:12:532
6236997648,9cyclictest181rcu_preempt00:16:352
6236997641,6cyclictest181rcu_preempt21:07:522
623699762,40cyclictest39-21ksoftirqd/222:51:332
6231997645,12cyclictest181rcu_preempt19:16:201
6231997644,7cyclictest181rcu_preempt21:57:571
6231997644,7cyclictest181rcu_preempt21:57:571
6231997640,11cyclictest19957-21kworker/u19:1-rpciod22:13:111
6231997640,11cyclictest181rcu_preempt23:46:111
6231997640,11cyclictest181rcu_preempt23:46:111
6231997636,12cyclictest181rcu_preempt23:15:521
6231997634,8cyclictest0-21swapper/122:03:131
6231997633,10cyclictest0-21swapper/120:59:141
6231997632,12cyclictest0-21swapper/120:06:141
6231997630,10cyclictest181rcu_preempt20:01:271
6231997628,12cyclictest0-21swapper/100:18:521
622699769,25cyclictest2374-21systemd-journal19:40:500
622699769,25cyclictest2374-21systemd-journal19:40:500
622699767,26cyclictest10317-21/usr/sbin/munin23:37:190
6226997662,10cyclictest6216-21cyclictest21:20:190
6226997660,10cyclictest13602-21diskmemload22:26:170
622699765,36cyclictest0-21swapper/022:19:040
622699765,32cyclictest23960-21taskset00:00:250
622699765,32cyclictest23960-21taskset00:00:250
6226997615,24cyclictest29485-21/usr/sbin/munin21:26:180
6226997612,31cyclictest25214-21ssh22:13:330
6226997612,25cyclictest27239-21wc20:01:260
6226997610,28cyclictest7066-21awk19:01:250
6236997554,14cyclictest450-21unin-run20:20:502
6236997549,8cyclictest181rcu_preempt19:45:512
6236997549,8cyclictest181rcu_preempt19:45:512
6236997547,8cyclictest181rcu_preempt21:58:042
6236997547,8cyclictest181rcu_preempt21:58:042
6236997538,17cyclictest181rcu_preempt22:21:142
6236997525,25cyclictest0-21swapper/222:01:122
6231997547,8cyclictest181rcu_preempt20:21:131
6231997539,10cyclictest181rcu_preempt20:46:221
6231997524,9cyclictest181rcu_preempt20:30:251
6231997524,9cyclictest181rcu_preempt20:30:251
6226997555,14cyclictest16669-21sh21:59:480
6226997555,14cyclictest16669-21sh21:59:480
622699755,27cyclictest30819-21sed23:16:240
622699754,36cyclictest0-21swapper/020:16:210
6226997529,31cyclictest352-21runrttasks00:06:000
622699752,46cyclictest19280-21ssh22:03:460
6226997513,26cyclictest13602-21diskmemload23:23:350
6226997511,26cyclictest4205-21ssh21:38:250
6226997511,26cyclictest4205-21ssh21:38:250
6226997511,23cyclictest11840-21chrt20:54:080
6226997510,30cyclictest17335-21/usr/sbin/munin19:31:200
6226997510,30cyclictest17335-21/usr/sbin/munin19:31:200
6236997453,8cyclictest181rcu_preempt21:31:072
6236997445,7cyclictest181rcu_preempt23:23:422
6231997457,11cyclictest20888-21ssh23:00:531
6231997457,11cyclictest20888-21ssh23:00:531
6231997442,7cyclictest181rcu_preempt22:40:031
6231997437,11cyclictest181rcu_preempt19:44:301
6231997437,11cyclictest181rcu_preempt19:44:301
6231997413,28cyclictest31-21ksoftirqd/123:19:121
6231997413,24cyclictest31-21ksoftirqd/123:51:271
622699747,28cyclictest12567-21cat20:56:130
622699746,31cyclictest4171-21apt-get20:31:040
6226997416,25cyclictest8919-21/usr/sbin/munin21:46:160
6226997416,25cyclictest8919-21/usr/sbin/munin21:46:160
6226997415,28cyclictest2374-21systemd-journal20:07:140
6226997414,24cyclictest19073-21sh21:09:250
6226997412,25cyclictest7961-21ssh00:26:360
6226997410,28cyclictest8150-21rm22:39:160
6226997410,22cyclictest27532-21/usr/sbin/munin23:11:160
477727413,37sleep24747-21apt-get18:56:202
6236997352,8cyclictest181rcu_preempt21:41:352
6236997336,11cyclictest181rcu_preempt00:02:422
6236997327,20cyclictest0-21swapper/219:40:522
6236997324,24cyclictest0-21swapper/219:55:532
6231997339,7cyclictest181rcu_preempt22:17:421
6231997338,8cyclictest181rcu_preempt00:24:341
6231997338,8cyclictest181rcu_preempt00:24:341
622699737,30cyclictest2031-21apt-get20:25:590
622699737,30cyclictest2031-21apt-get20:25:590
622699733,33cyclictest0-21swapper/022:56:280
622699733,33cyclictest0-21swapper/022:56:280
6236997244,7cyclictest181rcu_preempt21:02:422
6236997244,7cyclictest181rcu_preempt21:02:422
6236997241,10cyclictest181rcu_preempt21:00:522
6236997230,20cyclictest0-21swapper/220:21:252
6236997224,19cyclictest0-21swapper/220:40:512
6231997231,11cyclictest0-21swapper/120:36:081
622699727,42cyclictest0-21swapper/020:21:260
6226997218,21cyclictest7954-21/usr/sbin/munin20:41:210
6236997143,7cyclictest181rcu_preempt19:40:292
6236997133,15cyclictest181rcu_preempt21:22:012
622699719,25cyclictest10271-21fschecks_count19:11:090
6226997113,22cyclictest20184-21fschecks_count19:41:110
6226997113,22cyclictest20184-21fschecks_count19:41:110
6236997031,9cyclictest181rcu_preempt19:11:462
6231997036,8cyclictest181rcu_preempt20:41:131
475926611,34sleep14747-21apt-get18:56:101
606926412,35sleep30-21swapper/319:00:493
6241996142,12cyclictest451rcuc/322:22:583
624199612,26cyclictest2550-21chrt20:26:083
624199612,26cyclictest2550-21chrt20:26:083
6241996046,10cyclictest451rcuc/321:54:073
6241996046,10cyclictest451rcuc/321:54:073
6241995945,9cyclictest451rcuc/319:22:363
6241995943,11cyclictest451rcuc/300:16:193
6241995842,11cyclictest451rcuc/320:05:033
6241995744,8cyclictest451rcuc/323:05:243
6241995744,8cyclictest451rcuc/323:05:243
6241995643,8cyclictest451rcuc/323:15:003
6241995643,8cyclictest451rcuc/321:25:213
6241995641,9cyclictest451rcuc/319:30:013
6241995641,9cyclictest451rcuc/319:30:013
272762560,8sleep30-21swapper/300:05:523
6241995442,8cyclictest451rcuc/320:09:203
6241995442,8cyclictest451rcuc/319:12:073
6241995441,9cyclictest451rcuc/322:44:313
6241995440,9cyclictest451rcuc/320:53:193
6241995440,8cyclictest451rcuc/322:45:533
6241995439,10cyclictest451rcuc/319:20:253
6241995438,10cyclictest451rcuc/321:32:143
6241995340,9cyclictest451rcuc/319:03:243
6241995338,8cyclictest451rcuc/323:50:543
6241995239,8cyclictest451rcuc/322:02:183
6241995137,9cyclictest451rcuc/321:29:263
6241995038,8cyclictest451rcuc/320:36:503
6241995038,7cyclictest0-21swapper/320:11:033
6241995037,9cyclictest451rcuc/319:45:483
6241995037,9cyclictest451rcuc/319:45:483
6241995037,8cyclictest451rcuc/319:32:403
6241995037,8cyclictest451rcuc/319:32:403
6241995036,9cyclictest451rcuc/323:56:093
6241995036,9cyclictest451rcuc/323:56:093
6241995036,10cyclictest451rcuc/319:36:293
6241995036,10cyclictest451rcuc/319:36:293
624199503,37cyclictest20799-21chrt21:11:253
64362490,7sleep30-21swapper/300:25:423
64362490,7sleep30-21swapper/300:25:423
624199494,34cyclictest19795-21taskset23:51:573
6241994936,9cyclictest451rcuc/323:47:083
6241994936,8cyclictest451rcuc/322:20:103
6241994934,10cyclictest451rcuc/323:27:503
6241994934,10cyclictest451rcuc/320:41:403
624199493,35cyclictest7622-21chrt21:44:383
624199493,35cyclictest14411-21taskset21:01:163
624199493,35cyclictest14411-21taskset21:01:163
624199493,32cyclictest19803-21taskset21:10:523
624199483,36cyclictest32583-21taskset23:20:473
624199474,32cyclictest22950-21taskset19:50:493
624199473,34cyclictest395-21taskset22:26:173
624199473,33cyclictest6568-21chrt22:36:153
624199473,33cyclictest11163-21chrt23:37:463
624199473,32cyclictest32055-21taskset00:13:053
624199473,30cyclictest4304-21chrt20:31:063
6241994634,8cyclictest451rcuc/320:18:233
6241994634,8cyclictest451rcuc/319:09:523
624199463,33cyclictest24188-21chrt19:51:263
624199463,33cyclictest18178-21chrt22:56:103
624199463,33cyclictest18178-21chrt22:56:103
624199463,32cyclictest3090-21taskset22:31:043
624199463,32cyclictest22179-21taskset22:08:303
624199462,35cyclictest10616-21taskset21:49:403
624199462,35cyclictest10616-21taskset21:49:403
624199462,34cyclictest8933-21taskset00:29:233
624199462,34cyclictest8801-21taskset23:35:103
624199462,34cyclictest8801-21taskset23:35:103
624199462,34cyclictest13177-21chrt20:56:263
624199462,31cyclictest2349-21taskset21:35:543
624199462,31cyclictest2349-21taskset21:35:543
624199453,32cyclictest9592-21chrt20:46:213
624199453,32cyclictest24226-21chrt22:11:263
624199453,32cyclictest14892-21taskset21:56:343
624199453,32cyclictest14892-21taskset21:56:343
624199453,32cyclictest1285-21chrt20:21:223
624199453,31cyclictest24642-21taskset23:06:203
624199453,30cyclictest13894-21taskset23:42:083
6241994531,9cyclictest451rcuc/322:52:553
624199452,33cyclictest28059-21chrt00:06:203
624199443,30cyclictest458-21taskset23:20:593
624199433,30cyclictest24963-21taskset21:19:073
6241994129,8cyclictest451rcuc/319:56:453
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional