You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-25 - 05:31
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackbslot4.osadl.org (updated Thu Dec 25, 2025 00:43:35)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2360099742,66cyclictest24204-21/usr/sbin/munin19:03:491
2360099713,61cyclictest14179-21ksmtuned00:23:031
2360099712,62cyclictest24922-21/usr/sbin/munin21:58:451
2360099702,62cyclictest23030-21/usr/sbin/munin21:53:361
2360099692,61cyclictest13680-21/usr/sbin/munin21:28:521
2360099683,59cyclictest9809-21expr00:08:451
2360099682,60cyclictest26793-21/usr/sbin/munin22:03:431
2360099682,60cyclictest17419-21/usr/sbin/munin21:38:381
2360099682,32cyclictest31091-21/usr/sbin/munin20:48:431
2360099674,57cyclictest0-21swapper/121:18:341
2360099674,57cyclictest0-21swapper/121:18:341
2360099673,57cyclictest382-21systemd-journal23:33:171
2360099672,60cyclictest6938-21/usr/sbin/munin00:03:311
2360099672,59cyclictest8074-21/usr/sbin/munin21:13:341
2360099672,59cyclictest513-21/usr/sbin/munin20:53:471
2360099672,59cyclictest3181-21/usr/sbin/munin23:53:451
2360099672,59cyclictest3181-21/usr/sbin/munin23:53:451
2360099672,59cyclictest1307-21/usr/sbin/munin23:48:501
2360099672,32cyclictest19292-21/usr/sbin/munin21:43:461
2360099672,32cyclictest11097-21idleruntime00:13:311
2360099662,59cyclictest15553-21/usr/sbin/munin21:33:341
2360099662,58cyclictest21158-21/usr/sbin/munin21:48:461
2360099662,58cyclictest16289-21/usr/sbin/munin00:28:281
2360099662,29cyclictest26073-21/usr/sbin/munin19:08:511
2360099655,54cyclictest0-21swapper/121:08:431
2360099653,55cyclictest2461-21/usr/sbin/munin20:58:421
2360099652,57cyclictest28076-21/usr/sbin/munin23:33:331
2360099652,56cyclictest4339-21/usr/sbin/munin21:03:471
2360099652,56cyclictest29762-21latency20:43:421
2360099652,56cyclictest11815-21/usr/sbin/munin21:23:421
2360099652,56cyclictest11815-21/usr/sbin/munin21:23:421
2360099644,54cyclictest0-21swapper/123:03:191
2360099644,54cyclictest0-21swapper/123:03:191
2360099643,55cyclictest30608-21cat23:38:371
2360099642,57cyclictest14425-21/usr/sbin/munin00:23:491
2360099634,53cyclictest0-21swapper/120:38:351
2360099633,55cyclictest21703-21latency_hist20:23:221
2360099632,54cyclictest25319-21latency_hist20:33:221
2360099627,50cyclictest0-21swapper/122:48:191
2360099623,53cyclictest5065-21/usr/sbin/munin23:58:381
2360099622,55cyclictest31543-21latency_hist19:23:241
2360099614,50cyclictest0-21swapper/120:03:231
2360099613,50cyclictest0-21swapper/120:08:231
2360099612,53cyclictest27135-21latency_hist20:38:221
2360099612,53cyclictest21245-21missed_timers23:13:381
2360099603,52cyclictest17508-21missed_timers23:03:391
2360099603,52cyclictest17508-21missed_timers23:03:391
2360099603,50cyclictest0-21swapper/119:38:241
2360099602,52cyclictest1701-21latency_hist22:23:191
2360099602,31cyclictest382-21systemd-journal20:10:411
2360099593,51cyclictest0-21swapper/122:43:191
2360099593,49cyclictest0-21swapper/123:13:181
2360099593,49cyclictest0-21swapper/119:33:241
2360099593,22cyclictest0-21swapper/122:33:191
2360099592,52cyclictest31344-21proc_pri22:13:441
2360099592,51cyclictest31815-21/usr/sbin/munin23:43:301
2360099584,21cyclictest0-21swapper/122:58:201
2360099583,50cyclictest7126-21sshd22:36:381
2360099583,49cyclictest0-21swapper/119:48:241
2360099583,48cyclictest0-21swapper/119:43:241
2360099582,50cyclictest10418-21latency_hist19:53:241
2360099573,48cyclictest941-21crond19:28:231
2360099573,47cyclictest0-21swapper/122:58:191
2360099564,47cyclictest30435-21latency_hist22:13:201
2360099564,47cyclictest23519-21latency_hist20:28:221
2360099564,46cyclictest0-21swapper/122:28:201
2360099563,47cyclictest0-21swapper/119:18:241
2303325611,16sleep30-21swapper/318:59:313
2360099552,48cyclictest26188-21latency_hist23:28:181
23607995413,36cyclictest24804-21unixbench_multi20:28:522
2360799533,44cyclictest0-21swapper/222:58:042
2360799533,44cyclictest0-21swapper/222:58:042
2360099524,41cyclictest0-21swapper/120:18:231
2360799516,12cyclictest0-21swapper/219:13:352
2360099514,42cyclictest0-21swapper/119:58:221
23607995013,5cyclictest20754-21df23:13:302
2360799493,41cyclictest0-21swapper/222:28:442
2360799493,40cyclictest0-21swapper/219:33:392
2360099493,41cyclictest0-21swapper/123:19:371
233062499,13sleep10-21swapper/119:02:471
2360799488,8cyclictest15404-21unixbench-2d20:03:532
2360799485,10cyclictest0-21swapper/222:48:472
2360799484,38cyclictest0-21swapper/222:43:342
2360799484,38cyclictest0-21swapper/222:08:402
2360799484,38cyclictest0-21swapper/220:33:372
2360799484,38cyclictest0-21swapper/220:23:482
2360799483,39cyclictest0-21swapper/223:08:422
2360799483,38cyclictest0-21swapper/220:18:392
2359699484,38cyclictest0-21swapper/019:03:370
126652483,9sleep00-21swapper/000:18:290
2360799474,37cyclictest0-21swapper/222:23:362
2360799474,37cyclictest0-21swapper/222:18:382
2360799474,37cyclictest0-21swapper/219:27:422
2360799474,37cyclictest0-21swapper/219:18:502
2360799473,38cyclictest0-21swapper/219:08:532
2360799473,37cyclictest24338-21/usr/sbin/munin23:23:462
2360799473,37cyclictest0-21swapper/222:33:342
2359699474,37cyclictest0-21swapper/021:53:400
2360799467,34cyclictest8640-21/usr/sbin/munin19:48:482
2360799464,37cyclictest0-21swapper/223:18:362
2360799464,37cyclictest0-21swapper/219:43:422
2360799464,36cyclictest0-21swapper/222:38:332
2360799463,9cyclictest0-21swapper/220:13:442
2360799463,37cyclictest0-21swapper/222:58:382
2360799463,37cyclictest0-21swapper/222:58:382
2360099463,38cyclictest12646-21sshd22:50:371
2360799454,8cyclictest0-21swapper/220:08:452
2360799454,8cyclictest0-21swapper/219:58:462
2360799453,6cyclictest0-21swapper/219:53:442
2360799453,37cyclictest0-21swapper/222:13:352
2360799453,36cyclictest0-21swapper/219:38:342
2360799453,36cyclictest0-21swapper/219:28:562
193532453,6sleep30-21swapper/320:14:523
2361199444,35cyclictest0-21swapper/323:08:313
2360799444,8cyclictest0-21swapper/223:43:482
2360799444,35cyclictest0-21swapper/223:28:332
2360799444,35cyclictest0-21swapper/223:03:362
2360799444,35cyclictest0-21swapper/223:03:362
2360799443,9cyclictest0-21swapper/220:44:012
2360799443,36cyclictest0-21swapper/222:08:152
263742433,8sleep00-21swapper/023:28:320
23596994332,7cyclictest21074-21grep20:18:530
268112423,8sleep00-21swapper/020:34:320
2361199424,33cyclictest0-21swapper/323:06:123
2361199424,33cyclictest0-21swapper/323:06:123
96372413,8sleep20-21swapper/221:17:202
324722413,8sleep00-21swapper/020:50:100
89032403,7sleep00-21swapper/022:40:350
8542403,8sleep00-21swapper/023:45:420
84102403,8sleep20-21swapper/200:06:122
48972403,8sleep00-21swapper/019:38:310
38792403,8sleep20-21swapper/221:00:382
34042403,8sleep00-21swapper/022:26:510
313062403,8sleep20-21swapper/223:39:562
247772402,7sleep024877-21users20:28:530
23607994031,5cyclictest29-21ksoftirqd/220:38:222
23596994031,5cyclictest3-21ksoftirqd/021:13:210
141762403,7sleep30-21swapper/300:23:033
132902403,7sleep20-21swapper/221:26:172
132902403,7sleep20-21swapper/221:26:172
67652393,7sleep00-21swapper/019:43:300
56712393,6sleep30-21swapper/321:04:373
312842393,8sleep00-21swapper/023:39:380
296622393,8sleep00-21swapper/023:37:370
292712393,8sleep00-21swapper/019:14:370
23596993930,5cyclictest3-21ksoftirqd/000:03:160
2359699393,32cyclictest0-21swapper/021:04:060
23596993927,7cyclictest2377-21head19:28:530
158582393,7sleep00-21swapper/020:07:440
152272394,7sleep00-21swapper/021:32:060
103832393,8sleep20-21swapper/200:12:282
95942383,7sleep00-21swapper/021:16:490
294562383,6sleep30-21swapper/319:16:493
274342383,6sleep30-21swapper/319:09:573
23611993825,8cyclictest32008-21cut23:43:323
23607993828,5cyclictest29-21ksoftirqd/221:23:202
23607993828,5cyclictest29-21ksoftirqd/221:23:202
221862383,6sleep30-21swapper/323:17:443
190512383,6sleep30-21swapper/321:43:083
164882383,6sleep30-21swapper/323:01:393
164882383,6sleep30-21swapper/323:01:393
75312373,7sleep20-21swapper/221:09:312
64442373,6sleep30-21swapper/300:00:053
57332373,7sleep20-21swapper/221:05:212
52992373,6sleep30-21swapper/322:32:093
27952373,6sleep30-21swapper/319:33:153
268362373,6sleep30-21swapper/320:34:523
250172373,6sleep30-21swapper/320:30:253
2359699374,28cyclictest0-21swapper/000:17:360
23596993728,5cyclictest3-21ksoftirqd/022:18:190
23596993726,7cyclictest28492-21sed20:38:520
23596993724,8cyclictest3465-21sort20:58:490
206112373,30sleep00-21swapper/021:44:260
63262363,6sleep30-21swapper/319:40:433
51312363,7sleep00-21swapper/022:30:090
312712363,6sleep30-21swapper/319:21:083
276382363,6sleep30-21swapper/323:30:483
23607993623,8cyclictest15426-21wc00:23:462
23596993626,6cyclictest3-21ksoftirqd/023:08:180
23596993626,6cyclictest3-21ksoftirqd/023:08:180
23596993624,7cyclictest958-21tune2fs20:53:370
23596993624,7cyclictest7479-21wc00:03:370
2325523613,17sleep20-21swapper/219:02:082
48362353,7sleep20-21swapper/223:58:112
48362353,7sleep20-21swapper/223:58:112
250202353,8sleep20-21swapper/219:03:492
23611993522,8cyclictest8949-21find21:13:453
23607993523,7cyclictest25451-21cut21:58:372
2359699354,26cyclictest0-21swapper/000:13:010
23596993524,7cyclictest12371-21grep22:48:490
23596993519,12cyclictest23382-21swap23:18:470
2305723511,17sleep00-21swapper/018:59:490
158772353,6sleep30-21swapper/320:07:563
137232353,8sleep00-21swapper/019:59:360
2361199344,25cyclictest0-21swapper/322:43:493
2361199344,24cyclictest0-21swapper/320:47:443
23611993422,7cyclictest31129-21grep22:13:383
23611993422,7cyclictest22104-21uniq20:23:383
23611993419,9cyclictest548-21NetworkManager22:03:193
2359699344,25cyclictest0-21swapper/023:13:030
23596993422,7cyclictest31031-21grep19:18:520
2361199334,24cyclictest0-21swapper/322:08:433
2361199334,24cyclictest0-21swapper/320:20:363
2361199334,24cyclictest0-21swapper/320:09:193
2361199334,24cyclictest0-21swapper/319:58:493
2361199334,24cyclictest0-21swapper/300:29:353
2361199334,23cyclictest0-21swapper/323:23:373
23611993323,6cyclictest638-21runrttasks23:58:083
23611993323,6cyclictest638-21runrttasks23:58:083
23611993321,7cyclictest12037-21ps22:48:443
23611993314,14cyclictest2329-21sshd22:23:383
23607993321,7cyclictest32282-21tail20:48:522
23607993321,7cyclictest20182-21awk21:43:462
23607993320,7cyclictest14025-21cut21:28:352
2359699334,24cyclictest0-21swapper/021:22:390
2359699334,24cyclictest0-21swapper/021:22:390
23596993325,5cyclictest3-21ksoftirqd/020:48:210
23596993324,5cyclictest3-21ksoftirqd/022:38:190
186822332,6sleep018749-21ntp_offset20:13:440
2361199324,23cyclictest0-21swapper/322:37:383
2361199324,23cyclictest0-21swapper/321:23:493
2361199324,23cyclictest0-21swapper/321:23:493
2361199324,23cyclictest0-21swapper/319:43:413
2361199323,23cyclictest0-21swapper/300:23:303
23611993222,6cyclictest30268-21grep23:38:323
23611993220,7cyclictest6389-21forks21:08:353
23611993220,7cyclictest28773-21netstat23:33:393
23611993220,7cyclictest27969-21grep22:03:493
23611993220,7cyclictest1266-21head20:53:433
2360799325,20cyclictest0-21swapper/220:53:422
2359699324,23cyclictest0-21swapper/021:51:580
2359699324,23cyclictest0-21swapper/021:27:070
2359699324,23cyclictest0-21swapper/021:27:070
2359699324,22cyclictest0-21swapper/023:53:390
2359699324,22cyclictest0-21swapper/023:53:390
23596993223,5cyclictest3-21ksoftirqd/022:23:190
23596993223,5cyclictest3-21ksoftirqd/019:13:230
23596993222,5cyclictest3-21ksoftirqd/022:53:400
23596993222,5cyclictest3-21ksoftirqd/022:53:400
23596993222,5cyclictest3-21ksoftirqd/020:13:220
23596993220,7cyclictest32551-21sendmail_mailqu19:23:470
2361199314,23cyclictest0-21swapper/322:57:173
2361199314,23cyclictest0-21swapper/322:57:173
2361199314,22cyclictest0-21swapper/322:38:323
2361199314,22cyclictest0-21swapper/300:18:063
2361199313,24cyclictest0-21swapper/319:53:493
2361199313,23cyclictest0-21swapper/321:18:313
2361199313,23cyclictest0-21swapper/321:18:313
2361199313,23cyclictest0-21swapper/319:03:293
23611993121,6cyclictest32739-21tune2fs22:18:333
23611993120,7cyclictest32267-21grep20:48:513
23611993120,7cyclictest2568-21grep20:58:333
23611993119,7cyclictest8924-21cut19:48:383
23611993118,8cyclictest20030-21ntp_kernel_pll_21:43:423
23607993123,5cyclictest29-21ksoftirqd/200:03:162
23607993121,6cyclictest1870-21latency23:48:372
23607993120,7cyclictest16369-21ps21:33:452
23607993119,7cyclictest17245-21grep00:28:422
2359699317,20cyclictest548-21NetworkManager22:48:190
2359699314,22cyclictest0-21swapper/023:48:310
2359699314,22cyclictest0-21swapper/022:11:130
2359699314,22cyclictest0-21swapper/000:28:340
2359699314,21cyclictest0-21swapper/023:13:330
2359699314,21cyclictest0-21swapper/022:03:290
2359699313,24cyclictest0-21swapper/021:41:380
2359699313,23cyclictest0-21swapper/021:58:240
2359699313,23cyclictest0-21swapper/019:49:420
23596993121,6cyclictest15984-21sort21:33:360
106672313,8sleep20-21swapper/200:13:202
71022301,23sleep37110-21diskstats00:03:313
2361199304,22cyclictest0-21swapper/321:29:273
2361199304,21cyclictest0-21swapper/323:48:293
23611993017,8cyclictest16370-21grep21:33:453
2360799304,20cyclictest0-21swapper/221:53:292
23607993019,6cyclictest28158-21seq23:33:292
23607993016,8cyclictest13291-21ntpdc00:18:392
2359699305,20cyclictest0-21swapper/000:23:430
2359699304,21cyclictest0-21swapper/019:55:530
2359699304,19cyclictest0-21swapper/019:33:330
2359699303,23cyclictest0-21swapper/023:27:180
23596993020,6cyclictest15876-21sendmail_mailtr22:58:440
23596993020,6cyclictest15876-21sendmail_mailtr22:58:440
2361199294,19cyclictest0-21swapper/321:53:333
2361199294,19cyclictest0-21swapper/319:23:353
2361199293,21cyclictest0-21swapper/300:10:103
23611992918,7cyclictest21478-21grep21:48:343
2360799295,19cyclictest0-21swapper/221:38:352
2359699294,20cyclictest0-21swapper/020:23:290
2361199283,20cyclictest0-21swapper/320:38:293
23611992817,7cyclictest23442-21cat23:18:473
23607992819,5cyclictest22414-21/usr/sbin/munin21:48:502
2361199274,18cyclictest0-21swapper/319:33:383
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional