You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-03 - 08:26
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Fri Jul 03, 2026 00:44:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1278821610,20sleep3451rcuc/318:53:013
1936321180,5sleep20-21swapper/221:45:512
677121120,8sleep30-21swapper/321:24:063
677121120,8sleep30-21swapper/321:24:063
1365521106,17sleep10-21swapper/118:53:371
1437399944,76cyclictest32382-21ssh22:08:020
14384999040,10cyclictest181rcu_preempt19:58:361
14384998958,10cyclictest181rcu_preempt22:44:501
14392998858,21cyclictest8689-21forks21:28:102
14384998851,9cyclictest17228-21ssh00:25:201
14384998844,13cyclictest181rcu_preempt22:48:181
14373998867,15cyclictest14748-21fschecks_time21:38:120
14384998748,8cyclictest181rcu_preempt22:28:051
14392998639,7cyclictest181rcu_preempt00:14:502
14392998639,7cyclictest181rcu_preempt00:14:502
14384998663,10cyclictest181rcu_preempt23:24:121
14392998559,18cyclictest15788-21fschecks_time00:23:122
14392998549,15cyclictest181rcu_preempt23:10:062
14384998556,8cyclictest181rcu_preempt20:52:521
14384998550,11cyclictest181rcu_preempt21:13:571
14392998360,16cyclictest14165-21apt-config20:32:532
14392998338,13cyclictest181rcu_preempt19:32:532
14384998355,7cyclictest181rcu_preempt19:20:501
14384998346,8cyclictest181rcu_preempt23:37:331
14384998346,8cyclictest181rcu_preempt23:37:331
14384998343,8cyclictest181rcu_preempt19:48:121
14384998333,14cyclictest0-21swapper/120:08:331
14384998333,14cyclictest0-21swapper/120:08:331
14373998363,13cyclictest18246-21latency22:38:160
1437399835,31cyclictest15472-21apt-get00:23:050
1411628310,47sleep214137-21sh18:57:502
14392998253,14cyclictest0-21swapper/222:38:072
14384998252,8cyclictest5688-21ssh21:23:341
14384998252,8cyclictest5688-21ssh21:23:341
14373998222,27cyclictest23960-21ssh21:53:170
14392998162,11cyclictest0-21swapper/222:23:252
14392998129,16cyclictest0-21swapper/220:58:372
14384998160,14cyclictest19989-21apt-key19:12:541
14384998159,14cyclictest12294-21latency_hist23:22:541
14384998156,8cyclictest181rcu_preempt19:43:001
14384998156,8cyclictest181rcu_preempt19:43:001
14384998148,14cyclictest27763-21ssh23:48:161
14384998145,8cyclictest181rcu_preempt20:47:531
14384998135,14cyclictest181rcu_preempt21:06:351
1437399812,38cyclictest0-21swapper/021:28:040
14392998034,12cyclictest181rcu_preempt22:08:192
14392998010,35cyclictest39-21ksoftirqd/221:22:502
14384998049,9cyclictest14718-21ssh00:21:351
14384998042,8cyclictest181rcu_preempt19:27:531
14384998035,7cyclictest181rcu_preempt23:54:451
14384998035,7cyclictest181rcu_preempt23:54:451
14384998025,25cyclictest0-21swapper/120:27:511
14373998064,10cyclictest994-21fschecks_time23:58:120
1437399804,38cyclictest7484-21threads00:08:260
14373998017,24cyclictest29381-21sh22:03:040
14373998017,24cyclictest29381-21sh22:03:040
14373998013,28cyclictest29265-21/usr/sbin/munin21:08:190
14392997955,8cyclictest181rcu_preempt18:58:442
14392997953,9cyclictest22679-21rm22:45:432
14392997937,13cyclictest181rcu_preempt20:37:532
14384997953,9cyclictest8266-21kworker/u17:1+xprtiod00:06:171
14384997946,8cyclictest181rcu_preempt21:50:131
14384997946,8cyclictest181rcu_preempt21:50:131
14384997945,7cyclictest181rcu_preempt19:13:561
14384997944,13cyclictest5829-21kworker/u17:0-rpciod22:18:231
14384997940,17cyclictest6598-21/usr/sbin/munin00:08:271
14384997928,22cyclictest0-21swapper/123:38:441
14373997963,10cyclictest7929-21rm23:15:070
14392997852,20cyclictest30199-21acpi23:53:002
14392997852,20cyclictest30199-21acpi23:53:002
14384997849,8cyclictest181rcu_preempt19:07:541
14384997846,8cyclictest181rcu_preempt00:16:391
14384997846,8cyclictest181rcu_preempt00:16:391
14384997845,9cyclictest1380-21ssh23:58:221
14384997842,11cyclictest181rcu_preempt21:41:221
14384997837,13cyclictest181rcu_preempt21:54:171
14373997859,12cyclictest22136-21diskmemload23:24:210
14373997814,17cyclictest16993-21fschecks_time19:03:150
1437399781,34cyclictest28742-21fschecks_time19:38:120
14373997810,24cyclictest19040-21/usr/sbin/munin23:34:120
14373997810,24cyclictest19040-21/usr/sbin/munin23:34:120
1439299772,37cyclictest5941-21fschecks_count21:23:472
1439299772,37cyclictest5941-21fschecks_count21:23:472
14392997714,26cyclictest0-21swapper/223:59:592
14384997747,8cyclictest181rcu_preempt19:53:241
14384997742,12cyclictest181rcu_preempt22:33:081
14384997737,17cyclictest25212-21ssh21:02:271
14384997732,12cyclictest181rcu_preempt23:08:411
14373997753,18cyclictest26605-21latency_hist22:52:530
1437399771,38cyclictest29411-21cron22:57:490
1437399771,38cyclictest29411-21cron22:57:490
14373997712,22cyclictest29755-21ssh22:58:020
14373997712,21cyclictest14133-21apt-get18:58:040
14392997653,16cyclictest28689-21/usr/sbin/munin21:08:282
14392997647,20cyclictest22450-21apt-key20:57:552
1439299763,38cyclictest11868-21apt-get23:23:052
14392997619,9cyclictest0-21swapper/221:48:052
14392997619,9cyclictest0-21swapper/221:48:052
14384997639,8cyclictest181rcu_preempt21:18:561
1438499763,47cyclictest31-21ksoftirqd/121:43:041
14384997631,9cyclictest0-21swapper/123:17:071
14373997659,10cyclictest18100-21apt-key23:32:520
14373997659,10cyclictest18100-21apt-key23:32:520
14373997657,13cyclictest10069-21sh23:18:250
14373997657,13cyclictest10069-21sh23:18:250
14373997618,39cyclictest0-21swapper/019:18:040
14373997616,20cyclictest19676-21snmpd19:23:250
14392997547,8cyclictest181rcu_preempt20:48:082
14392997546,20cyclictest22171-21sh23:38:262
14392997533,13cyclictest181rcu_preempt23:03:132
14384997535,8cyclictest0-21swapper/123:31:301
14384997535,8cyclictest0-21swapper/123:31:301
1437399759,28cyclictest30245-21cpu23:53:060
1437399759,28cyclictest30245-21cpu23:53:060
14373997558,11cyclictest297-21systemd-logind22:22:500
14373997551,17cyclictest6548-21latency_hist00:07:530
14373997517,22cyclictest20506-21modprobe20:52:490
14373997516,28cyclictest21772sleep023:05:440
14392997456,11cyclictest26361-21/usr/sbin/munin21:58:102
14392997453,15cyclictest300-21rs:main2
14392997453,15cyclictest22136-21diskmemload21:03:102
14392997449,16cyclictest297-21systemd-logind20:42:512
14392997449,16cyclictest297-21systemd-logind20:42:512
14392997442,12cyclictest181rcu_preempt22:05:512
14392997442,12cyclictest181rcu_preempt22:05:512
14392997433,8cyclictest181rcu_preempt19:52:502
14384997450,7cyclictest181rcu_preempt19:38:281
14384997449,7cyclictest181rcu_preempt22:02:561
14384997449,7cyclictest181rcu_preempt22:02:561
14384997438,7cyclictest181rcu_preempt22:56:241
14384997438,7cyclictest181rcu_preempt22:56:241
14384997426,13cyclictest0-21swapper/123:03:241
1437399749,26cyclictest21617-21munin-run19:17:500
1437399748,19cyclictest17460-21sshd21:58:500
1437399743,38cyclictest21243-21switchtime21:48:250
1437399743,38cyclictest21243-21switchtime21:48:250
1437399742,36cyclictest3276-21find19:58:240
14373997421,34cyclictest0-21swapper/022:13:060
14373997421,34cyclictest0-21swapper/022:13:060
14373997413,23cyclictest21007-21ssh22:43:100
14373997412,24cyclictest0-21swapper/020:12:530
14373997412,24cyclictest0-21swapper/020:12:530
14392997353,14cyclictest28174-21timerandwakeup23:48:272
14392997348,19cyclictest17780-21sh23:32:192
14392997348,19cyclictest17780-21sh23:32:192
14392997345,20cyclictest17204-21latency_hist21:42:522
14392997335,12cyclictest181rcu_preempt19:08:262
14392997331,12cyclictest181rcu_preempt19:58:142
14384997341,10cyclictest181rcu_preempt22:16:181
14384997341,10cyclictest181rcu_preempt22:16:181
14384997340,10cyclictest181rcu_preempt21:58:571
14384997339,11cyclictest181rcu_preempt22:58:061
14384997328,17cyclictest0-21swapper/122:12:501
14384997328,12cyclictest181rcu_preempt20:18:411
1437399739,26cyclictest22127-21apt-get20:58:050
14373997354,14cyclictest9725-21sh22:23:240
1437399734,36cyclictest31680-21latency_hist19:47:520
1437399734,36cyclictest31680-21latency_hist19:47:520
1437399733,25cyclictest15-21ksoftirqd/000:20:480
14373997329,35cyclictest15332-21grep20:34:190
1437399732,29cyclictest20083-21munin-run21:47:490
14373997311,27cyclictest3876-21/usr/sbin/munin23:08:190
14392997244,8cyclictest181rcu_preempt19:53:052
14392997242,13cyclictest1914-21ssh21:17:342
14392997232,13cyclictest181rcu_preempt21:34:182
14392997232,13cyclictest181rcu_preempt21:34:182
1439299722,49cyclictest30041-21ssh22:58:112
1439299722,36cyclictest10722-21latency_hist20:22:522
14384997240,10cyclictest181rcu_preempt20:03:221
14373997257,11cyclictest14361-21cyclictest19:48:260
14373997252,14cyclictest11796-21idleruntime21:33:130
14373997252,14cyclictest11796-21idleruntime21:33:130
1437399724,42cyclictest352-21runrttasks00:15:020
1437399724,42cyclictest352-21runrttasks00:15:020
14373997212,24cyclictest31930-21apt-get21:13:260
14392997139,8cyclictest181rcu_preempt20:13:212
14392997139,8cyclictest181rcu_preempt20:13:212
1439299712,36cyclictest15740-21ls22:33:272
14384997135,10cyclictest0-21swapper/122:23:201
14384997132,9cyclictest0-21swapper/120:13:231
14384997132,9cyclictest0-21swapper/120:13:231
1437399715,41cyclictest5514-21/usr/sbin/munin21:23:430
1437399715,41cyclictest5514-21/usr/sbin/munin21:23:430
14373997153,13cyclictest14361-21cyclictest20:57:150
14373997120,8cyclictest161ktimers/020:17:530
14373997119,14cyclictest19051-21/usr/sbin/munin19:08:240
14373997114,9cyclictest14809-21/usr/sbin/munin22:33:150
14392997055,9cyclictest7717-21uptime00:08:282
14392997046,17cyclictest21725-21latency_hist19:17:522
14392997044,8cyclictest181rcu_preempt22:52:452
14392997042,20cyclictest18924-21fschecks_count23:34:102
14392997042,20cyclictest18924-21fschecks_count23:34:102
14392997035,11cyclictest58-21kcompactd022:18:222
14392997024,13cyclictest0-21swapper/223:43:132
14392997024,13cyclictest0-21swapper/223:43:132
14392997013,23cyclictest0-21swapper/220:23:182
14392997012,20cyclictest27085-21grep19:33:112
14384997055,11cyclictest14361-21cyclictest21:33:121
14384997055,11cyclictest14361-21cyclictest21:33:121
14384997053,12cyclictest12483-21kworker/u17:3-rpciod23:43:231
14384997053,12cyclictest12483-21kworker/u17:3-rpciod23:43:231
1437399708,39cyclictest28621-21ssh23:49:110
1437399707,27cyclictest0-21swapper/021:18:200
1437399704,56cyclictest26640-21modprobe19:32:490
1437399704,36cyclictest11812-21/usr/sbin/munin22:28:050
1437399703,34cyclictest27862-21runrttasks21:06:270
1437399703,27cyclictest15-21ksoftirqd/023:41:100
14373997010,26cyclictest14054-21apt-key20:32:520
14392996947,8cyclictest181rcu_preempt22:53:452
14392996947,8cyclictest181rcu_preempt22:53:452
14392996947,8cyclictest181rcu_preempt00:03:222
14392996942,19cyclictest12249-21latency_hist23:22:542
14392996942,19cyclictest12249-21latency_hist23:22:542
14392996940,9cyclictest181rcu_preempt21:53:252
1439299692,22cyclictest16285-21munin-node19:03:032
14384996941,8cyclictest181rcu_preempt23:18:241
14384996929,11cyclictest0-21swapper/120:35:131
14384996915,23cyclictest25568-21fschecks_time19:28:121
1437399696,13cyclictest0-21swapper/023:43:190
1437399696,13cyclictest0-21swapper/023:43:190
14373996925,34cyclictest4397-21fschecks_time20:03:100
14373996923,24cyclictest0-21swapper/019:55:160
14392996843,8cyclictest181rcu_preempt19:43:052
14392996843,8cyclictest181rcu_preempt19:43:052
1439299683,24cyclictest0-21swapper/220:03:102
14384996853,10cyclictest17278-21munin-run20:42:501
14384996853,10cyclictest17278-21munin-run20:42:501
14384996828,13cyclictest29925-21ssh21:08:461
14384996826,12cyclictest0-21swapper/122:38:391
14373996851,12cyclictest14361-21cyclictest20:42:360
14373996851,12cyclictest14361-21cyclictest20:42:360
1437399684,36cyclictest18877-21modprobe20:47:490
14373996813,17cyclictest9013-21date20:17:510
14373996813,17cyclictest9013-21date20:17:510
14392996747,7cyclictest181rcu_preempt00:19:072
14392996739,7cyclictest181rcu_preempt22:14:272
14392996739,7cyclictest181rcu_preempt22:14:272
14392996715,16cyclictest12831-21unixbench_multi22:28:262
14373996710,33cyclictest28256-21munin-plugin-st19:37:500
14392996640,8cyclictest181rcu_preempt19:23:232
14392996624,9cyclictest181rcu_preempt20:43:112
1437399669,18cyclictest11002-21fschecks_count20:23:110
14384996533,9cyclictest0-21swapper/120:53:151
14384996529,9cyclictest0-21swapper/119:32:541
14373996512,14cyclictest14525-21latency_hist18:57:560
14392996427,16cyclictest2374-21systemd-journal20:11:342
14392996427,16cyclictest2374-21systemd-journal20:11:342
14384996427,13cyclictest181rcu_preempt21:28:211
14392996343,13cyclictest0-21swapper/219:38:012
14384996339,15cyclictest0-21swapper/119:02:521
14384996331,8cyclictest181rcu_preempt20:28:121
1439299612,44cyclictest22929-21timerwakeupswit19:18:552
14408996047,9cyclictest451rcuc/319:53:053
1440899593,43cyclictest13533-21taskset22:30:073
14408995845,8cyclictest451rcuc/323:23:293
14408995643,9cyclictest451rcuc/322:52:513
1440899563,42cyclictest30190-21taskset23:53:003
1440899563,42cyclictest30190-21taskset23:53:003
1440899554,40cyclictest780-21taskset22:08:263
14408995536,13cyclictest451rcuc/319:22:143
1440899534,37cyclictest8398-21chrt20:13:233
1440899534,37cyclictest8398-21chrt20:13:233
14408995339,9cyclictest451rcuc/319:00:183
1440899533,39cyclictest30404-21chrt22:58:213
1440899533,39cyclictest15419-21taskset22:33:203
1440899533,37cyclictest12773-21chrt21:34:043
1440899533,37cyclictest12773-21chrt21:34:043
1440899533,32cyclictest12427-21chrt20:27:533
1440899532,39cyclictest12525-21taskset00:18:023
1440899532,38cyclictest18884-21taskset23:34:073
1440899532,38cyclictest18884-21taskset23:34:073
1440899532,37cyclictest18188-21chrt22:38:143
1440899532,35cyclictest6479-21chrt00:07:523
14408995239,9cyclictest451rcuc/323:20:083
14408995239,9cyclictest451rcuc/323:20:083
14408995238,10cyclictest451rcuc/319:07:563
1440899523,36cyclictest23243-21chrt22:47:183
1440899523,34cyclictest18341-21chrt20:43:253
1440899522,36cyclictest28274-21chrt21:07:363
1440899513,37cyclictest30878-21taskset19:43:243
1440899513,37cyclictest30878-21taskset19:43:243
1440899513,37cyclictest20356-21chrt19:13:383
1440899513,34cyclictest30678-21chrt21:10:523
1440899513,34cyclictest29065-21chrt19:38:213
14408995129,15cyclictest451rcuc/323:39:233
1440899504,33cyclictest26921-21chrt22:53:063
1440899504,33cyclictest26921-21chrt22:53:063
14408995037,8cyclictest451rcuc/321:47:353
14408995036,9cyclictest451rcuc/321:48:043
14408995036,9cyclictest451rcuc/321:48:043
1440899503,35cyclictest971-21chrt23:58:113
1440899503,35cyclictest337-21taskset21:14:193
1440899503,34cyclictest9275-21taskset22:23:143
1440899503,34cyclictest17673-21chrt19:03:303
1440899503,32cyclictest27931-21chrt21:59:423
1440899503,32cyclictest10092-21chrt21:29:543
177442490,7sleep30-21swapper/323:32:123
177442490,7sleep30-21swapper/323:32:123
14408994937,8cyclictest451rcuc/323:08:073
14408994936,8cyclictest451rcuc/300:25:253
1440899493,36cyclictest14547-21taskset20:33:533
1440899493,33cyclictest27278-21taskset19:33:153
1440899493,32cyclictest25319-21chrt21:55:453
1440899493,31cyclictest3965-21chrt21:19:583
1440899492,34cyclictest2650-21chrt19:58:063
1440899492,32cyclictest24030-21chrt19:23:143
1440899492,32cyclictest13104-21chrt20:28:223
1440899484,34cyclictest29935-21taskset22:03:193
1440899484,34cyclictest29935-21taskset22:03:193
1440899483,33cyclictest26922-21chrt23:47:493
1440899483,33cyclictest26922-21chrt23:47:493
1440899483,32cyclictest10073-21chrt00:13:193
1440899483,32cyclictest10073-21chrt00:13:193
14408994830,11cyclictest451rcuc/300:10:203
14408994733,9cyclictest451rcuc/320:09:313
14408994733,9cyclictest451rcuc/320:09:313
14408994733,9cyclictest451rcuc/319:52:283
1440899473,33cyclictest6618-21taskset22:18:233
1440899473,32cyclictest14473-21chrt21:38:053
1440899473,30cyclictest406-21chrt23:03:083
1440899473,28cyclictest22588-21taskset20:57:553
14408994633,9cyclictest451rcuc/323:48:123
1440899463,32cyclictest25272-21chrt21:02:373
1440899462,31cyclictest4572-21chrt22:15:073
1440899462,31cyclictest4572-21chrt22:15:073
14408994532,9cyclictest451rcuc/320:40:093
14408994532,9cyclictest451rcuc/320:40:093
1440899452,31cyclictest6197-21chrt23:12:573
1440899452,31cyclictest26676-21chrt19:32:503
1440899444,30cyclictest19330-21chrt20:48:103
1440899433,26cyclictest5588-21taskset20:07:503
14408994330,9cyclictest451rcuc/320:18:513
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional