You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-03 - 00:11
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot7.osadl.org (updated Thu Jul 02, 2026 12:44:27)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1563421149,79sleep20-21swapper/206:54:392
14673211360,15sleep1181rcu_preempt06:53:361
16090991045,87cyclictest20192-21apt-get07:08:061
160909910175,20cyclictest2374-21systemd-journal12:27:511
160859910057,16cyclictest20826-21ssh12:25:490
16090999937,51cyclictest0-21swapper/112:02:541
1609099976,79cyclictest23547-21sh10:43:061
1609099971,32cyclictest26819-21diskmemload09:02:521
1609099967,80cyclictest14268-21apt-get10:28:071
1609099967,80cyclictest14268-21apt-get10:28:071
16090999547,41cyclictest9605-21latency_hist09:27:571
1609099949,74cyclictest10176-21apt-get09:28:111
16090999445,37cyclictest0-21swapper/110:42:561
1609099935,79cyclictest0-21swapper/108:33:051
1609099922,61cyclictest27995-21apt-get07:33:131
1609099922,61cyclictest27995-21apt-get07:33:131
16090999171,14cyclictest16077-21cyclictest09:47:551
16090999171,14cyclictest16077-21cyclictest09:47:551
16090999067,15cyclictest2374-21systemd-journal11:29:351
1609099894,70cyclictest0-21swapper/108:08:071
16090998939,42cyclictest0-21swapper/112:18:281
16099998851,12cyclictest181rcu_preempt12:06:212
16099998851,12cyclictest181rcu_preempt12:06:212
1609099884,75cyclictest0-21swapper/108:48:071
1609099884,75cyclictest0-21swapper/107:53:061
16090998836,41cyclictest0-21swapper/110:08:141
16099998729,11cyclictest181rcu_preempt09:38:162
16090998762,17cyclictest27022-21sh11:42:511
16090998731,44cyclictest17260-21/usr/sbin/munin10:33:171
16099998668,12cyclictest29773-21ssh09:07:492
16090998643,36cyclictest831-21cpu09:13:091
1609099863,77cyclictest0-21swapper/111:43:031
1609099863,69cyclictest0-21swapper/108:28:051
16085998659,19cyclictest31609-21latency_hist07:42:540
16085998659,19cyclictest31609-21latency_hist07:42:540
16099998566,9cyclictest0-21swapper/210:12:542
16099998563,14cyclictest19172-21ssh10:35:402
16099998533,11cyclictest181rcu_preempt09:22:512
16090998540,33cyclictest22628-21grep08:53:121
1609099852,75cyclictest0-21swapper/111:23:041
16090998511,65cyclictest8006-21apt-get10:18:171
16085998542,13cyclictest181rcu_preempt09:37:270
16085998534,23cyclictest15-21ksoftirqd/012:02:530
16099998446,9cyclictest181rcu_preempt08:58:032
16090998454,24cyclictest7500-21apt-key10:17:521
1609099843,69cyclictest0-21swapper/111:18:011
1609099843,68cyclictest0-21swapper/108:23:081
1609099842,76cyclictest0-21swapper/112:08:061
16085998442,16cyclictest58-21kcompactd011:37:180
16085998438,13cyclictest181rcu_preempt08:32:110
16085998438,12cyclictest181rcu_preempt12:05:120
16085998438,12cyclictest181rcu_preempt12:05:120
16099998336,9cyclictest181rcu_preempt07:08:322
16090998362,14cyclictest16077-21cyclictest07:02:051
16090998362,14cyclictest16077-21cyclictest07:02:051
1609099835,70cyclictest0-21swapper/107:48:041
16090998342,33cyclictest9656-21ntp_kernel_err11:13:181
1609099833,66cyclictest0-21swapper/107:13:051
16099998257,14cyclictest0-21swapper/210:42:552
16099998236,13cyclictest181rcu_preempt09:08:432
1609099825,59cyclictest17519-21apt-get08:38:061
1609099825,59cyclictest17519-21apt-get08:38:061
16085998262,14cyclictest23782-21diskmemload10:53:160
16085998262,14cyclictest23782-21diskmemload10:53:160
16085998236,12cyclictest181rcu_preempt09:31:570
16099998135,8cyclictest181rcu_preempt07:07:562
16099998135,8cyclictest181rcu_preempt07:07:562
1609099814,72cyclictest0-21swapper/110:53:061
1609099814,72cyclictest0-21swapper/110:53:061
1609099814,71cyclictest0-21swapper/111:53:071
1609099814,71cyclictest0-21swapper/111:53:071
1609099813,68cyclictest0-21swapper/107:43:021
16085998161,13cyclictest16077-21cyclictest07:59:030
16085998131,11cyclictest181rcu_preempt10:38:160
16085998112,50cyclictest23527-21apt-get10:43:140
16099998050,13cyclictest181rcu_preempt12:23:092
16099998044,9cyclictest181rcu_preempt09:48:042
1609099804,65cyclictest9213-21apt-get08:13:041
16090998037,35cyclictest0-21swapper/109:38:191
1609099803,6cyclictest0-21swapper/112:13:041
16090998036,36cyclictest0-21swapper/112:03:251
16090998036,36cyclictest0-21swapper/112:03:251
16085998059,15cyclictest1858-21threads09:13:400
16085998058,13cyclictest13936-21ssh12:13:280
16085998046,16cyclictest181rcu_preempt12:10:070
16085998035,13cyclictest58-21kcompactd011:51:340
1608599802,49cyclictest18361-21apt-get11:28:370
1539928022,39sleep30-21swapper/306:54:363
16099997961,12cyclictest4442-21ntp_kernel_err11:58:182
16099997953,20cyclictest2249-21idleruntime-cro07:52:512
16099997951,20cyclictest10169-21fschecks_time12:08:132
16099997949,13cyclictest181rcu_preempt11:18:492
16090997953,17cyclictest1554-21ssh10:07:541
1609099793,68cyclictest0-21swapper/107:03:081
1609099793,68cyclictest0-21swapper/107:03:081
16090997930,41cyclictest0-21swapper/110:59:561
1609099792,30cyclictest5112-21sh11:06:031
1608599797,55cyclictest30364-21apt-get09:08:110
16085997933,12cyclictest181rcu_preempt11:27:540
16085997932,12cyclictest181rcu_preempt11:42:290
16099997859,14cyclictest21231-21kworker/u18:2+events_unbound07:47:512
16099997858,10cyclictest0-21swapper/206:58:252
16099997858,10cyclictest0-21swapper/206:58:252
16099997857,12cyclictest0-21swapper/208:53:182
16099997838,29cyclictest3219-21kworker/u19:1+nfsiod11:29:482
16099997835,9cyclictest181rcu_preempt11:36:432
1609999782,50cyclictest18810-21latency_hist12:22:552
1609099784,64cyclictest0-21swapper/107:18:041
16090997837,33cyclictest0-21swapper/109:53:201
16085997846,11cyclictest181rcu_preempt09:57:090
16085997841,7cyclictest181rcu_preempt10:08:270
16085997840,11cyclictest7653-21apt-config10:17:540
16099997756,14cyclictest2374-21systemd-journal10:04:352
16099997723,13cyclictest181rcu_preempt11:48:282
1609099774,59cyclictest0-21swapper/108:03:061
1609099774,59cyclictest0-21swapper/108:03:061
1609099773,68cyclictest0-21swapper/109:48:011
16085997742,10cyclictest181rcu_preempt08:09:310
16085997739,12cyclictest181rcu_preempt09:06:140
16085997720,31cyclictest15-21ksoftirqd/008:13:240
139662773,7sleep00-21swapper/010:27:550
16099997659,8cyclictest0-21swapper/210:13:242
16099997654,12cyclictest0-21swapper/208:02:552
16099997645,16cyclictest181rcu_preempt09:43:112
16099997645,16cyclictest181rcu_preempt09:43:112
1609999761,32cyclictest4242-21cmp07:57:552
16090997651,16cyclictest11440-21kernelversion10:23:171
1609099763,62cyclictest27102-21apt-get09:03:021
1609099763,60cyclictest0-21swapper/107:38:041
1609099763,60cyclictest0-21swapper/107:38:041
16090997612,35cyclictest3854-21apt-get07:58:061
16085997658,13cyclictest0-21swapper/010:37:510
16085997636,11cyclictest181rcu_preempt08:52:540
1526827611,41sleep015297-21/usr/sbin/munin06:54:330
16099997557,8cyclictest0-21swapper/211:52:592
16099997557,8cyclictest0-21swapper/211:52:592
16099997552,17cyclictest14248-21/usr/sbin/munin10:29:082
16099997552,17cyclictest14248-21/usr/sbin/munin10:29:082
16099997547,7cyclictest181rcu_preempt07:15:472
16099997543,11cyclictest181rcu_preempt09:58:362
1609999753,51cyclictest23604-21ssh10:43:162
16099997527,25cyclictest0-21swapper/209:53:142
1609099754,60cyclictest0-21swapper/107:23:031
16090997535,32cyclictest0-21swapper/110:02:531
1608599755,43cyclictest15-21ksoftirqd/007:08:250
16085997553,13cyclictest10002-21latency_hist09:27:560
1608599755,30cyclictest15-21ksoftirqd/008:46:290
1608599752,35cyclictest5777-21latency_hist11:07:510
16099997457,11cyclictest297-21systemd-logind10:52:522
1609999744,37cyclictest0-21swapper/209:25:352
1609099742,64cyclictest19132-21apt-get08:43:031
1609099742,60cyclictest6106-21apt-get11:08:021
16085997447,7cyclictest181rcu_preempt09:02:360
16085997444,21cyclictest24749-21modprobe07:22:510
16085997442,8cyclictest181rcu_preempt07:48:220
16099997357,9cyclictest0-21swapper/211:08:262
16099997351,15cyclictest26173-21sshd07:25:362
16099997348,10cyclictest181rcu_preempt09:33:282
16099997346,14cyclictest0-21swapper/208:47:542
16099997340,12cyclictest181rcu_preempt09:28:402
16099997324,12cyclictest181rcu_preempt08:08:242
1609099733,60cyclictest27614-21grep10:48:271
16085997352,14cyclictest16077-21cyclictest11:53:260
16085997352,14cyclictest16077-21cyclictest11:53:260
16085997340,8cyclictest181rcu_preempt08:39:540
16085997340,8cyclictest181rcu_preempt08:39:540
16085997339,8cyclictest181rcu_preempt11:14:210
16085997333,8cyclictest181rcu_preempt10:58:200
1608599733,37cyclictest22424-21awk08:53:010
16085997329,10cyclictest181rcu_preempt07:43:160
16085997314,30cyclictest15-21ksoftirqd/009:22:260
16099997258,9cyclictest31899-21ssh10:56:572
16099997258,9cyclictest31899-21ssh10:56:572
16099997250,16cyclictest16077-21cyclictest11:44:072
16099997243,20cyclictest6209-21fschecks_time08:03:142
16099997243,20cyclictest6209-21fschecks_time08:03:142
16099997238,16cyclictest181rcu_preempt07:33:362
16099997238,16cyclictest181rcu_preempt07:33:362
16099997226,15cyclictest0-21swapper/211:00:522
1609099723,63cyclictest0-21swapper/107:28:051
1609099723,61cyclictest0-21swapper/109:33:151
1609099722,30cyclictest11488-21tr08:18:251
1609099722,24cyclictest5289-21rm09:19:131
16085997253,13cyclictest13996-21latency_hist08:27:550
16085997248,18cyclictest16458-21fschecks_count06:58:120
16085997248,18cyclictest16458-21fschecks_count06:58:120
16085997236,8cyclictest181rcu_preempt09:58:230
16085997235,12cyclictest181rcu_preempt07:26:370
1610599713,52cyclictest14293-21chrt10:28:053
1610599713,52cyclictest14293-21chrt10:28:053
16099997149,14cyclictest0-21swapper/208:33:132
16099997140,9cyclictest0-21swapper/211:27:542
16099997135,9cyclictest181rcu_preempt08:23:302
16099997130,9cyclictest181rcu_preempt08:13:162
16099997126,12cyclictest181rcu_preempt11:13:202
16090997115,48cyclictest1866-21wc09:13:401
16085997144,7cyclictest181rcu_preempt09:48:130
16085997141,10cyclictest181rcu_preempt11:45:540
16085997140,12cyclictest181rcu_preempt11:18:290
16085997136,9cyclictest181rcu_preempt09:46:420
16085997136,9cyclictest181rcu_preempt09:46:420
1608599713,42cyclictest15-21ksoftirqd/009:39:330
16085997130,17cyclictest181rcu_preempt07:30:320
16085997111,23cyclictest14268-21apt-get10:28:080
16085997111,23cyclictest14268-21apt-get10:28:080
16099997054,8cyclictest0-21swapper/210:23:142
16099997047,13cyclictest0-21swapper/208:39:462
16099997047,13cyclictest0-21swapper/208:39:462
1608599708,13cyclictest15-21ksoftirqd/012:18:010
16085997035,11cyclictest181rcu_preempt10:03:330
16085997031,13cyclictest181rcu_preempt07:53:120
16085997025,21cyclictest15-21ksoftirqd/008:03:280
16085997025,21cyclictest15-21ksoftirqd/008:03:280
1610599697,48cyclictest28517-21chrt07:33:143
1610599697,48cyclictest28517-21chrt07:33:143
16099996934,13cyclictest181rcu_preempt12:13:482
16099996920,25cyclictest0-21swapper/209:14:512
16090996931,32cyclictest0-21swapper/111:33:101
16085996936,8cyclictest181rcu_preempt07:35:000
16085996936,8cyclictest181rcu_preempt07:35:000
16085996934,7cyclictest181rcu_preempt11:08:020
1610599683,51cyclictest10206-21chrt09:28:073
16099996838,10cyclictest181rcu_preempt07:20:332
1609099683,59cyclictest23782-21diskmemload11:48:291
16085996837,7cyclictest181rcu_preempt08:33:070
16085996836,8cyclictest181rcu_preempt08:22:540
16085996836,10cyclictest10458-21rm10:22:140
16085996730,14cyclictest181rcu_preempt07:03:180
16085996730,14cyclictest181rcu_preempt07:03:180
16085996711,32cyclictest15-21ksoftirqd/010:50:230
16099996638,19cyclictest22353-21latency_hist08:52:552
16099996633,11cyclictest181rcu_preempt11:03:232
16099996629,12cyclictest181rcu_preempt07:28:102
16099996542,13cyclictest0-21swapper/208:22:542
16099996539,8cyclictest181rcu_preempt11:40:382
16099996534,10cyclictest181rcu_preempt08:28:142
16099996344,9cyclictest0-21swapper/207:42:512
16099996344,9cyclictest0-21swapper/207:42:512
16099996331,12cyclictest181rcu_preempt10:18:272
16085996334,9cyclictest181rcu_preempt07:13:100
1610599617,36cyclictest0-21swapper/307:08:063
1610599613,50cyclictest0-21swapper/311:28:073
16105996124,24cyclictest28086-21taskset07:32:533
16105996113,34cyclictest7946-21chrt12:03:263
16105996113,34cyclictest7946-21chrt12:03:263
16105996018,28cyclictest29368-21chrt10:52:543
1610599594,38cyclictest10119-21chrt12:08:123
16105995910,32cyclictest0-21swapper/310:43:083
16105995825,22cyclictest30388-21chrt09:08:053
1610599582,43cyclictest17845-21taskset07:02:563
1610599582,43cyclictest17845-21taskset07:02:563
1610599582,39cyclictest5641-21taskset10:13:263
16105995823,23cyclictest13517-21chrt11:19:203
1610599573,35cyclictest8958-21chrt08:12:513
16105995725,22cyclictest7957-21chrt09:23:293
16105995724,22cyclictest17518-21chrt08:38:033
16105995724,22cyclictest17518-21chrt08:38:033
16105995724,20cyclictest21709-21chrt12:27:543
16105995723,22cyclictest31844-21chrt11:49:323
16105995721,23cyclictest1132-21taskset11:53:133
16105995721,23cyclictest1132-21taskset11:53:133
16105995720,26cyclictest13522-21chrt12:13:233
16105995720,26cyclictest10944-21chrt10:22:553
16105995720,25cyclictest29646-21taskset09:59:243
16105995710,39cyclictest0-21swapper/310:18:163
1610599564,37cyclictest17199-21chrt08:37:543
1610599564,36cyclictest30500-21taskset10:53:273
1610599564,36cyclictest30500-21taskset10:53:273
16105995623,21cyclictest16732-21chrt11:24:563
16105995622,21cyclictest25606-21chrt11:38:543
16105995621,23cyclictest28663-21chrt09:04:443
16105995621,23cyclictest25940-21taskset09:00:313
16105995621,23cyclictest25469-21taskset07:23:173
16105995620,25cyclictest29531-21taskset11:46:323
1610599559,35cyclictest25421-21taskset09:53:123
1610599553,39cyclictest20510-21taskset08:47:513
1610599553,37cyclictest2578-21chrt11:02:223
1610599553,35cyclictest14238-21taskset09:33:303
16105995522,21cyclictest1240-21chrt07:48:163
16105995521,20cyclictest23016-21chrt07:16:213
16105995520,23cyclictest17493-21taskset12:19:513
16105995519,23cyclictest30082-21taskset07:37:563
16105995519,23cyclictest30082-21taskset07:37:563
1610599543,36cyclictest23125-21chrt09:48:263
1610599542,40cyclictest20689-21chrt09:44:373
1610599542,40cyclictest20689-21chrt09:44:373
16105995423,19cyclictest4651-21chrt11:04:453
16105995422,21cyclictest9923-21chrt11:13:253
16105995422,21cyclictest23277-21chrt11:35:463
16105995422,21cyclictest12432-21chrt08:23:043
16105995422,20cyclictest16961-21taskset09:38:253
16105995419,23cyclictest467-21chrt10:05:113
1610599533,37cyclictest1653-21chrt09:13:363
1610599532,38cyclictest6422-21chrt08:03:193
1610599532,38cyclictest6422-21chrt08:03:193
1610599532,36cyclictest21632-21chrt08:48:283
16105995322,20cyclictest6122-21chrt12:01:393
16105995322,20cyclictest3945-21chrt09:18:063
16105995320,22cyclictest2513-21chrt07:53:023
16105995320,22cyclictest22436-21chrt08:53:053
16105995319,23cyclictest6134-21chrt11:08:063
16105995318,23cyclictest18326-21taskset10:33:293
16105995318,22cyclictest15189-21taskset08:30:173
16105995220,19cyclictest1824-21chrt10:08:073
16105995219,21cyclictest10436-21chrt08:16:323
16105995213,30cyclictest0-21swapper/307:58:093
16105995121,20cyclictest24788-21chrt07:22:533
16105995119,21cyclictest21646-21chrt10:39:123
16105995119,21cyclictest12074-21chrt08:21:543
16105995117,21cyclictest32721-21chrt07:43:393
16105994919,20cyclictest19449-21chrt07:05:153
16105994919,20cyclictest19449-21chrt07:05:153
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional