You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-16 - 22:35
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackbslot7.osadl.org (updated Thu Apr 16, 2026 12:44:28)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
32197211410,72sleep231683-21apt-get06:58:252
12019910960,40cyclictest0-21swapper/209:18:132
1051210911,65sleep01100-21idleruntime-cro07:03:040
11989910781,17cyclictest1187-21cyclictest08:03:071
11989910781,17cyclictest1187-21cyclictest08:03:071
12019910425,34cyclictest1-21systemd07:18:052
11989910445,9cyclictest0-21swapper/109:08:261
11989910245,8cyclictest0-21swapper/109:43:061
11989910243,7cyclictest0-21swapper/111:28:411
12019910153,43cyclictest1187-21cyclictest09:53:402
12019910144,8cyclictest0-21swapper/209:38:362
11989910134,12cyclictest0-21swapper/109:04:181
12019910045,10cyclictest0-21swapper/210:38:282
11989910049,44cyclictest0-21swapper/110:18:251
11989910047,7cyclictest0-21swapper/110:03:061
11989910031,24cyclictest4609-21modprobe08:53:031
1201999832,16cyclictest0-21swapper/211:23:072
1201999768,16cyclictest27848-21kworker/u17:0-ext4-rsv-conversion10:33:072
1201999740,16cyclictest15266-21grep10:08:272
1201999733,22cyclictest7042-21ntp_kernel_pll_08:58:322
244052960,7sleep10-21swapper/110:23:301
1198999643,8cyclictest0-21swapper/111:58:201
1189999578,11cyclictest2952-21systemd-journal10:03:040
1198999414,34cyclictest6344-21wc08:58:061
1198999414,34cyclictest6344-21wc08:58:061
1201999341,13cyclictest18396-21idleruntime-cro11:08:032
120199933,40cyclictest27110-21apt-key10:28:082
1201999326,24cyclictest8887-21cstates09:04:172
1198999334,11cyclictest0-21swapper/108:42:341
1201999276,10cyclictest297-21systemd-logind12:28:042
119899923,37cyclictest30430-21fschecks_count10:33:251
1201999167,15cyclictest1187-21cyclictest10:33:212
120199913,37cyclictest12797-21cpu10:58:212
120199913,37cyclictest12797-21cpu10:58:212
1198999134,14cyclictest0-21swapper/109:45:451
1198999134,14cyclictest0-21swapper/109:45:451
1198999073,11cyclictest352-21runrttasks11:03:041
1198999073,11cyclictest352-21runrttasks11:03:041
1198999045,10cyclictest1187-21cyclictest10:44:071
1198999040,27cyclictest27694-21fschecks_count10:29:111
1189999073,11cyclictest2952-21systemd-journal10:45:250
1198998961,19cyclictest1187-21cyclictest07:18:041
1189998968,15cyclictest10041-21sh07:28:230
1201998764,13cyclictest0-21swapper/209:48:272
120199873,34cyclictest8072-21grep11:43:332
1198998767,12cyclictest0-21swapper/109:23:061
1189998765,15cyclictest6508-21sh09:53:300
1201998666,15cyclictest58-21kcompactd010:48:572
1201998666,15cyclictest58-21kcompactd010:48:572
1189998655,25cyclictest27165-21acpi10:28:150
1198998564,11cyclictest0-21swapper/111:23:071
120199844,29cyclictest21470-21fschecks_time08:03:262
120199844,29cyclictest21470-21fschecks_time08:03:262
1201998368,10cyclictest1187-21cyclictest10:43:122
1201998362,10cyclictest0-21swapper/207:58:272
1201998362,10cyclictest0-21swapper/207:58:272
1198998353,20cyclictest27399-21sh08:23:041
1201998227,26cyclictest0-21swapper/210:03:032
1198998259,13cyclictest0-21swapper/108:23:301
119899821,44cyclictest3594-21ntpq09:48:351
118999828,36cyclictest15-21ksoftirqd/008:18:070
118999825,29cyclictest15-21ksoftirqd/007:03:140
118999825,29cyclictest15-21ksoftirqd/007:03:140
118999824,54cyclictest15-21ksoftirqd/011:38:340
118999822,54cyclictest15-21ksoftirqd/008:28:370
1198998156,14cyclictest0-21swapper/111:08:061
118999814,37cyclictest15-21ksoftirqd/012:08:190
1201998063,11cyclictest298-21in:imuxsock07:48:032
1201998060,9cyclictest0-21swapper/208:23:262
1189998062,12cyclictest2952-21systemd-journal09:32:240
1189998062,12cyclictest2952-21systemd-journal09:32:240
1189998062,12cyclictest1265-21ssh10:38:320
1189998059,15cyclictest21838-21threads10:18:390
1189998048,25cyclictest0-21swapper/010:48:220
1189998048,25cyclictest0-21swapper/010:48:220
118999804,33cyclictest15-21ksoftirqd/007:13:060
118999802,32cyclictest15-21ksoftirqd/008:33:390
1198997947,23cyclictest298-21in:imuxsock08:13:031
1189997962,11cyclictest11840-21ssh09:08:290
1189997960,13cyclictest2424-21threads08:43:390
1189997955,17cyclictest544-21cron08:28:040
118999794,52cyclictest15-21ksoftirqd/007:49:240
118999793,43cyclictest15-21ksoftirqd/009:39:500
1189997929,25cyclictest15-21ksoftirqd/007:57:550
1189997925,32cyclictest15-21ksoftirqd/007:24:250
118999792,44cyclictest15-21ksoftirqd/009:18:040
1189997912,53cyclictest15-21ksoftirqd/010:10:260
120199788,56cyclictest27945-21apt-get11:23:332
120199788,56cyclictest27945-21apt-get11:23:332
1201997857,14cyclictest1187-21cyclictest11:33:412
1198997861,11cyclictest19323-21ntp_offset11:08:331
1189997859,13cyclictest27402-21latency_hist11:23:070
118999782,42cyclictest15-21ksoftirqd/009:51:260
1201997761,9cyclictest0-21swapper/209:33:312
1201997754,12cyclictest12660-21latency_hist10:58:072
1189997759,12cyclictest7879-21diskmemload10:58:210
1189997759,12cyclictest7879-21diskmemload10:58:210
1189997759,12cyclictest2952-21systemd-journal12:23:020
1189997748,25cyclictest58-21kcompactd007:33:130
1189997748,25cyclictest58-21kcompactd007:33:130
118999773,42cyclictest22396-21open_files11:13:370
1189997725,28cyclictest15-21ksoftirqd/010:36:380
118999772,47cyclictest15-21ksoftirqd/011:48:070
118999772,45cyclictest15-21ksoftirqd/010:15:410
118999772,34cyclictest3897-21find08:48:360
1189997721,33cyclictest15-21ksoftirqd/008:10:470
1201997652,15cyclictest1895-21ntp_kernel_pll_07:03:412
1201997652,15cyclictest1895-21ntp_kernel_pll_07:03:412
1198997661,10cyclictest1187-21cyclictest11:46:291
1189997656,13cyclictest28430-21ssh11:24:350
1189997656,13cyclictest28430-21ssh11:24:350
118999765,43cyclictest14413-21timerwakeupswit11:53:400
1189997654,16cyclictest1150-21latency_hist11:33:070
118999764,42cyclictest1469-21/usr/sbin/munin11:33:390
118999764,41cyclictest15-21ksoftirqd/009:18:390
1189997615,44cyclictest15-21ksoftirqd/008:23:060
1201997561,8cyclictest0-21swapper/208:13:252
1201997557,12cyclictest19124-21kernelversion11:08:292
1201997556,13cyclictest30911-21/usr/sbin/munin11:28:292
1201997553,12cyclictest0-21swapper/207:48:262
1201997552,17cyclictest22978-21ntp_kernel_err12:08:312
1201997537,7cyclictest181rcu_preempt11:55:402
1198997556,9cyclictest0-21swapper/112:23:351
1198997553,12cyclictest0-21swapper/111:43:051
1189997556,13cyclictest10737-21rm11:48:260
118999754,51cyclictest15-21ksoftirqd/012:24:180
118999754,41cyclictest26635-21apt10:28:030
1189997534,27cyclictest15-21ksoftirqd/008:54:530
1189997534,27cyclictest15-21ksoftirqd/008:54:530
1201997452,14cyclictest16778-21kworker/u18:0-rpciod10:16:242
1198997457,11cyclictest277-21dbus-daemon07:08:051
1198997457,11cyclictest277-21dbus-daemon07:08:051
1198997455,13cyclictest7871-21sh09:03:031
1198997438,19cyclictest0-21swapper/107:43:071
1198997438,19cyclictest0-21swapper/107:43:071
1189997459,10cyclictest1187-21cyclictest12:28:520
1189997445,20cyclictest14469-21modprobe07:43:030
1189997445,20cyclictest14469-21modprobe07:43:030
118999743,38cyclictest352-21runrttasks12:03:580
118999743,38cyclictest352-21runrttasks12:03:580
118999742,32cyclictest15-21ksoftirqd/008:58:300
1189997414,37cyclictest15-21ksoftirqd/008:41:270
1201997356,9cyclictest0-21swapper/212:18:042
1201997356,9cyclictest0-21swapper/212:18:042
1201997355,10cyclictest0-21swapper/207:08:282
1198997352,10cyclictest0-21swapper/110:38:301
1189997356,11cyclictest2693-21ssh09:48:060
1189997356,11cyclictest2693-21ssh09:48:060
118999734,38cyclictest352-21runrttasks10:05:100
118999733,42cyclictest17408-21timerwakeupswit11:58:400
118999732,61cyclictest6659-21/usr/sbin/munin07:18:380
118999732,49cyclictest15-21ksoftirqd/011:07:260
118999731,47cyclictest15-21ksoftirqd/009:08:070
1189997314,32cyclictest15-21ksoftirqd/011:12:310
120199726,57cyclictest4604-21cron08:53:032
1201997258,8cyclictest0-21swapper/207:53:392
1201997257,8cyclictest0-21swapper/207:23:392
1201997255,10cyclictest352-21runrttasks11:38:232
1201997249,14cyclictest0-21swapper/208:18:382
1201997246,18cyclictest323-21cut08:38:262
120199723,27cyclictest6410-21latency_hist08:58:072
120199723,27cyclictest6410-21latency_hist08:58:072
1198997256,8cyclictest0-21swapper/110:08:411
1198997253,10cyclictest0-21swapper/111:33:211
1198997251,12cyclictest0-21swapper/112:28:351
1198997248,16cyclictest7879-21diskmemload12:13:381
1198997248,16cyclictest7879-21diskmemload12:13:381
1198997243,21cyclictest31-21ksoftirqd/112:08:361
118999729,41cyclictest15-21ksoftirqd/007:16:230
1189997245,10cyclictest181rcu_preempt07:58:320
1189997245,10cyclictest181rcu_preempt07:58:320
1189997231,23cyclictest15-21ksoftirqd/007:45:280
112427214,41sleep30-21swapper/307:03:073
321892719,37sleep132180-21apt-get06:58:201
1201997151,12cyclictest0-21swapper/210:18:242
1201997149,14cyclictest0-21swapper/211:48:202
1201997143,7cyclictest181rcu_preempt09:08:322
1198997150,12cyclictest0-21swapper/107:48:411
1198997147,15cyclictest1187-21cyclictest08:33:211
1198997134,8cyclictest181rcu_preempt11:48:301
1198997125,18cyclictest0-21swapper/109:35:481
1189997154,9cyclictest0-21swapper/008:03:250
1189997154,9cyclictest0-21swapper/008:03:250
118999714,56cyclictest20416-21/usr/sbin/munin09:23:380
1189997142,11cyclictest181rcu_preempt12:15:280
1189997142,11cyclictest181rcu_preempt12:15:280
1201997051,8cyclictest0-21swapper/209:28:392
1201997051,8cyclictest0-21swapper/209:28:392
1201997048,17cyclictest26994-21kworker/u18:0+events_unbound07:33:042
1201997042,7cyclictest181rcu_preempt08:08:262
1198997052,9cyclictest0-21swapper/112:18:341
1198997050,11cyclictest0-21swapper/109:28:301
1198997050,11cyclictest0-21swapper/109:28:301
1198997049,12cyclictest0-21swapper/107:28:211
1198997048,11cyclictest0-21swapper/107:08:341
1198997025,10cyclictest1910-21fschecks_time08:43:261
1189997048,15cyclictest26450-21ssh09:33:140
1201996955,7cyclictest0-21swapper/207:18:192
1201996948,11cyclictest0-21swapper/212:08:062
1201996948,11cyclictest0-21swapper/212:08:062
1201996933,17cyclictest7879-21diskmemload11:15:422
1201996928,17cyclictest0-21swapper/212:28:392
1198996950,12cyclictest1187-21cyclictest10:54:421
1198996940,21cyclictest12851-21cron07:38:031
1198996940,21cyclictest12851-21cron07:38:031
118999696,39cyclictest15-21ksoftirqd/010:58:010
1201996854,8cyclictest0-21swapper/208:33:402
1201996840,20cyclictest2211-21sh08:43:352
1201996823,16cyclictest0-21swapper/209:43:522
1201996823,16cyclictest0-21swapper/209:43:522
1198996849,10cyclictest0-21swapper/110:53:071
1198996849,10cyclictest0-21swapper/110:53:071
1201996753,8cyclictest0-21swapper/209:23:382
120199673,40cyclictest30767-21latency_hist08:33:062
1198996753,8cyclictest0-21swapper/107:23:401
1198996752,8cyclictest0-21swapper/111:25:011
1198996752,8cyclictest0-21swapper/111:25:011
1198996748,9cyclictest0-21swapper/108:28:291
1201996653,7cyclictest0-21swapper/209:13:302
1201996648,11cyclictest0-21swapper/207:38:252
1201996648,11cyclictest0-21swapper/207:38:252
1198996649,8cyclictest0-21swapper/111:13:211
1198996549,8cyclictest0-21swapper/112:03:261
1198996549,8cyclictest0-21swapper/112:03:261
1198996539,17cyclictest14921-21fschecks_count07:43:251
1198996527,10cyclictest181rcu_preempt11:53:361
1198996525,14cyclictest7515-21sed07:18:381
120199645,24cyclictest12593-21ntp_states10:03:352
1201996446,11cyclictest0-21swapper/207:33:242
1201996446,11cyclictest0-21swapper/207:33:242
1201996434,7cyclictest181rcu_preempt12:19:172
1198996447,8cyclictest0-21swapper/108:08:071
1198996420,9cyclictest181rcu_preempt10:13:271
1201996343,9cyclictest0-21swapper/211:58:402
1198996322,9cyclictest181rcu_preempt08:13:361
1198996246,9cyclictest0-21swapper/110:03:301
119899623,39cyclictest20416-21/usr/sbin/munin09:23:361
119899622,45cyclictest7065-21grep09:53:401
119899603,42cyclictest15341-21timerandwakeup09:13:401
1198995911,35cyclictest18566-21grep07:53:351
120299583,45cyclictest2321-21taskset11:33:393
1198995844,8cyclictest0-21swapper/108:03:251
120299579,34cyclictest8456-21chrt09:03:193
120299574,43cyclictest23161-21taskset12:08:363
120299573,40cyclictest16637-21taskset10:10:153
120299553,40cyclictest22430-21chrt10:19:393
1202995524,21cyclictest26276-21chrt12:13:393
1202995524,21cyclictest26276-21chrt12:13:393
120299544,41cyclictest32587-21chrt10:37:183
120299543,39cyclictest31005-21taskset12:22:513
120299543,33cyclictest13609-21taskset11:53:213
120299533,38cyclictest15412-21chrt11:03:033
120299533,38cyclictest15412-21chrt11:03:033
120299533,37cyclictest18646-21chrt07:53:373
120299533,36cyclictest3474-21chrt08:48:243
120299533,36cyclictest32408-21chrt12:23:403
120299533,33cyclictest25976-21chrt08:18:073
120299533,32cyclictest21367-21chrt11:13:003
120299523,38cyclictest18186-21chrt10:13:233
120299523,38cyclictest15494-21taskset09:13:413
120299523,37cyclictest18545-21chrt11:08:063
120299523,36cyclictest15368-21chrt07:43:363
120299523,35cyclictest0-21swapper/311:23:303
120299523,35cyclictest0-21swapper/311:23:303
120299522,39cyclictest19739-21chrt07:58:223
120299522,39cyclictest19739-21chrt07:58:223
120299514,33cyclictest0-21swapper/310:28:283
120299513,39cyclictest27351-21chrt11:22:573
120299513,38cyclictest2250-21chrt12:28:263
120299513,37cyclictest8294-21taskset07:23:193
120299513,37cyclictest6993-21taskset11:42:393
120299513,36cyclictest4945-21chrt07:13:063
120299513,35cyclictest5665-21taskset10:46:013
120299513,35cyclictest16807-21chrt11:58:273
120299512,37cyclictest24649-21chrt11:18:073
120299512,36cyclictest1349-21chrt11:33:063
120299512,34cyclictest1649-21chrt08:43:143
120299512,32cyclictest11921-21chrt10:03:093
120299503,36cyclictest32690-21chrt09:43:233
120299503,36cyclictest32690-21chrt09:43:233
120299503,36cyclictest20621-21chrt09:23:223
120299503,35cyclictest6764-21chrt09:53:373
120299503,34cyclictest2749-21chrt07:08:043
120299503,34cyclictest2749-21chrt07:08:043
120299503,34cyclictest24415-21chrt09:28:413
120299503,34cyclictest24415-21chrt09:28:413
120299503,32cyclictest8186-21chrt07:23:073
120299502,39cyclictest29926-21taskset09:38:293
120299502,37cyclictest642-21chrt08:38:363
120299493,34cyclictest11404-21chrt09:08:143
120299493,33cyclictest30192-21chrt08:28:403
120299493,30cyclictest26409-21chrt09:33:103
120299493,29cyclictest22737-21chrt08:08:063
120299493,29cyclictest22737-21chrt08:08:063
120299492,35cyclictest26386-21taskset08:18:273
120299492,35cyclictest24896-21chrt10:23:403
120299492,35cyclictest2394-21chrt10:40:143
120299483,35cyclictest10025-21chrt10:53:273
120299483,32cyclictest9250-21chrt09:58:273
120299483,32cyclictest12945-21chrt07:38:053
120299483,32cyclictest12945-21chrt07:38:053
120299483,32cyclictest12617-21chrt11:51:433
120299482,36cyclictest28347-21chrt08:23:383
1202994820,20cyclictest7174-21chrt08:58:373
120299474,30cyclictest18025-21chrt09:18:313
120299473,34cyclictest13420-21chrt07:38:263
120299473,34cyclictest13420-21chrt07:38:263
120299473,32cyclictest10215-21chrt11:48:063
120299472,34cyclictest21245-21chrt12:05:413
120299472,34cyclictest21245-21chrt12:05:413
120299463,34cyclictest23636-21chrt08:08:393
120299463,33cyclictest17037-21chrt07:48:393
120299463,32cyclictest4325-21chrt09:49:233
120299462,32cyclictest5413-21chrt07:13:273
120299462,32cyclictest5080-21chrt08:53:233
120299462,32cyclictest5080-21chrt08:53:233
120299453,29cyclictest31168-21chrt08:33:263
120299442,32cyclictest10243-21taskset07:28:303
120299433,30cyclictest9578-21chrt10:53:063
120299433,30cyclictest9578-21chrt10:53:063
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional