You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-25 - 17:57
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot6.osadl.org (updated Wed Mar 25, 2026 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2240221710,5sleep0297699cyclictest12:46:320
628921620,4sleep2298899cyclictest09:17:292
1266821590,5sleep1298099cyclictest13:08:371
106891950,4ptp4l401ktimersoftd/308:07:013
304882660,2sleep230487-21fschecks_count13:27:252
308142640,5sleep1298099cyclictest09:02:221
22972640,5sleep0297699cyclictest10:46:590
299399600,22cyclictest22829-21mailstats12:12:313
299399581,23cyclictest16267-21python11:32:303
299399580,24cyclictest30485-21chrt12:53:413
299399580,24cyclictest30485-21chrt12:53:413
2980995828,7cyclictest25-21ksoftirqd/113:27:101
299399571,25cyclictest9148-21taskset09:24:183
2980995717,6cyclictest25-21ksoftirqd/111:52:351
153202570,3sleep20-21swapper/212:37:422
299399561,23cyclictest20232-21sh12:42:463
299399560,25cyclictest17837-21sh12:42:033
299399560,24cyclictest12139-21sh10:56:453
299399554,19cyclictest0-21swapper/310:18:183
299399551,24cyclictest30418-21sh11:14:003
299399551,24cyclictest30418-21sh11:14:003
299399550,23cyclictest590-21sh10:44:063
2988995547,4cyclictest33-21ksoftirqd/212:22:192
2976995419,4cyclictest9-21ksoftirqd/008:45:060
299399531,29cyclictest13797-21taskset11:31:023
299399531,21cyclictest26544-21strings08:52:233
299399530,23cyclictest10487-21taskset08:19:193
2980995324,7cyclictest25-21ksoftirqd/111:02:341
2980995324,7cyclictest25-21ksoftirqd/111:02:341
299399521,24cyclictest25206-21sh11:08:213
298099524,10cyclictest25-21ksoftirqd/113:22:101
2980995224,7cyclictest25-21ksoftirqd/110:22:241
2976995216,10cyclictest9-21ksoftirqd/010:27:230
60422510,2sleep20-21swapper/210:49:382
2980995134,4cyclictest25-21ksoftirqd/109:57:271
2980995125,4cyclictest25-21ksoftirqd/110:42:221
2980995123,7cyclictest25-21ksoftirqd/110:02:181
2980995123,7cyclictest25-21ksoftirqd/109:27:181
2980995123,7cyclictest25-21ksoftirqd/109:27:181
299399500,24cyclictest10956-21taskset12:33:373
2980995021,7cyclictest25-21ksoftirqd/113:32:221
297699507,10cyclictest9-21ksoftirqd/012:57:230
297699507,10cyclictest9-21ksoftirqd/012:37:200
297699506,9cyclictest9-21ksoftirqd/013:32:300
2976995013,9cyclictest9-21ksoftirqd/011:42:200
72524928,9sleep20-21swapper/208:02:122
298099493,8cyclictest16191-21munin-run12:07:081
2980994935,3cyclictest25-21ksoftirqd/111:07:221
2980994924,4cyclictest25-21ksoftirqd/108:27:151
2980994923,4cyclictest25-21ksoftirqd/112:12:261
2980994922,7cyclictest25-21ksoftirqd/112:57:211
2980994921,8cyclictest25-21ksoftirqd/113:02:241
297699497,9cyclictest9-21ksoftirqd/010:12:180
297699496,9cyclictest9-21ksoftirqd/011:57:280
297699496,10cyclictest9-21ksoftirqd/013:22:310
297699496,10cyclictest9-21ksoftirqd/011:17:070
297699496,10cyclictest9-21ksoftirqd/011:17:070
2976994921,4cyclictest9-21ksoftirqd/012:07:120
2976994919,5cyclictest9-21ksoftirqd/010:33:360
298099484,10cyclictest25-21ksoftirqd/113:27:231
2980994836,3cyclictest25-21ksoftirqd/110:27:241
2980994833,3cyclictest25-21ksoftirqd/108:42:321
2980994823,4cyclictest25-21ksoftirqd/109:22:341
2980994821,7cyclictest25-21ksoftirqd/110:57:191
2980994820,7cyclictest25-21ksoftirqd/110:37:181
2980994820,7cyclictest25-21ksoftirqd/109:37:251
2980994820,6cyclictest25-21ksoftirqd/111:27:281
2980994819,7cyclictest25-21ksoftirqd/110:52:171
297699487,8cyclictest9-21ksoftirqd/012:22:090
297699486,9cyclictest9-21ksoftirqd/009:17:210
297699486,10cyclictest9-21ksoftirqd/008:32:250
297699485,10cyclictest9-21ksoftirqd/009:42:180
297699484,11cyclictest9-21ksoftirqd/013:12:280
297699484,10cyclictest9-21ksoftirqd/011:32:200
2976994821,7cyclictest9-21ksoftirqd/013:05:280
2976994820,7cyclictest9-21ksoftirqd/012:37:080
2976994818,7cyclictest9-21ksoftirqd/013:17:210
299399470,25cyclictest12117-21seq13:07:403
298099475,10cyclictest15776-21ssh13:12:251
2980994732,3cyclictest25-21ksoftirqd/111:37:231
2980994731,3cyclictest25-21ksoftirqd/108:17:251
298099473,11cyclictest25-21ksoftirqd/109:42:271
2980994721,7cyclictest25-21ksoftirqd/108:07:161
2980994720,7cyclictest25-21ksoftirqd/111:32:291
2980994720,7cyclictest25-21ksoftirqd/109:47:241
2980994719,7cyclictest25-21ksoftirqd/112:27:231
297699477,9cyclictest9-21ksoftirqd/008:07:310
297699475,9cyclictest9-21ksoftirqd/009:12:210
297699475,9cyclictest9-21ksoftirqd/008:52:030
297699474,10cyclictest9-21ksoftirqd/010:52:230
2976994719,7cyclictest9-21ksoftirqd/009:07:150
2976994719,4cyclictest9-21ksoftirqd/012:26:020
2976994717,7cyclictest9-21ksoftirqd/010:26:510
298099467,7cyclictest25-21ksoftirqd/108:47:331
298099466,7cyclictest25-21ksoftirqd/110:47:061
298099464,9cyclictest25-21ksoftirqd/112:17:381
298099464,9cyclictest17213-21ssh12:07:251
298099464,7cyclictest25-21ksoftirqd/112:52:381
298099464,7cyclictest25-21ksoftirqd/112:52:381
298099463,11cyclictest8318-21cron08:17:021
2980994622,4cyclictest25-21ksoftirqd/111:12:181
2980994622,4cyclictest25-21ksoftirqd/111:12:181
2980994619,7cyclictest25-21ksoftirqd/112:37:141
298099461,10cyclictest25-21ksoftirqd/110:17:351
297699469,5cyclictest9-21ksoftirqd/011:17:250
297699468,7cyclictest9-21ksoftirqd/009:32:330
297699466,9cyclictest9-21ksoftirqd/009:37:250
297699466,9cyclictest29284-21cut12:52:310
297699466,9cyclictest29284-21cut12:52:310
297699466,10cyclictest9-21ksoftirqd/009:22:190
297699463,6cyclictest9-21ksoftirqd/009:52:260
2976994620,9cyclictest9-21ksoftirqd/012:02:290
2976994613,9cyclictest9-21ksoftirqd/010:57:320
298099455,7cyclictest25-21ksoftirqd/108:37:151
298099455,11cyclictest25-21ksoftirqd/108:52:181
298099453,8cyclictest25-21ksoftirqd/110:14:361
298099453,7cyclictest25-21ksoftirqd/112:22:221
2980994530,3cyclictest25-21ksoftirqd/111:57:351
2980994520,4cyclictest25-21ksoftirqd/112:32:491
298099450,10cyclictest25-21ksoftirqd/111:47:291
297699453,7cyclictest9-21ksoftirqd/008:12:050
297699453,6cyclictest9-21ksoftirqd/010:47:320
2976994518,9cyclictest9-21ksoftirqd/011:53:000
297699450,8cyclictest9-21ksoftirqd/011:37:200
299399441,22cyclictest9871-21taskset11:59:403
298099447,7cyclictest25-21ksoftirqd/110:32:241
298099445,7cyclictest25-21ksoftirqd/109:12:191
2980994420,4cyclictest25-21ksoftirqd/111:21:101
2980994420,3cyclictest25-21ksoftirqd/109:32:201
2980994419,4cyclictest25-21ksoftirqd/110:07:241
2980994415,10cyclictest25-21ksoftirqd/112:52:091
297699448,9cyclictest4366-21ssh12:27:260
297699446,10cyclictest9-21ksoftirqd/010:37:230
297699445,9cyclictest9-21ksoftirqd/011:47:260
297699445,8cyclictest9-21ksoftirqd/009:02:330
297699444,9cyclictest9-21ksoftirqd/009:47:290
2976994418,4cyclictest9-21ksoftirqd/011:25:040
2976994416,7cyclictest9-21ksoftirqd/008:57:210
2976994416,4cyclictest9-21ksoftirqd/011:32:070
299399431,23cyclictest28347-21diskmemload10:59:233
299399431,23cyclictest0-21swapper/313:07:073
298099434,9cyclictest121rcu_preempt12:45:431
298099434,10cyclictest25-21ksoftirqd/111:42:351
298099433,6cyclictest25-21ksoftirqd/108:57:181
2980994319,4cyclictest25-21ksoftirqd/111:22:251
2980994319,4cyclictest25-21ksoftirqd/108:32:311
2980994318,4cyclictest25-21ksoftirqd/109:52:211
297699439,4cyclictest9-21ksoftirqd/008:19:410
297699435,5cyclictest9-21ksoftirqd/010:18:050
297699434,9cyclictest9-21ksoftirqd/010:02:280
297699431,6cyclictest9-21ksoftirqd/013:07:280
2976994315,7cyclictest9-21ksoftirqd/009:27:330
2976994315,7cyclictest9-21ksoftirqd/009:27:330
2976994315,7cyclictest9-21ksoftirqd/008:27:180
297699430,7cyclictest101ktimersoftd/010:07:270
299399421,24cyclictest20720-21ssh11:04:243
299399421,24cyclictest20720-21ssh11:04:243
2993994210,19cyclictest6654-21sh13:36:253
2980994217,11cyclictest25-21ksoftirqd/109:17:191
297699423,8cyclictest9-21ksoftirqd/011:07:180
297699423,5cyclictest9-21ksoftirqd/011:02:180
297699423,5cyclictest9-21ksoftirqd/011:02:180
299399411,24cyclictest16053-21ssh10:27:203
299399411,23cyclictest11720-21taskset09:31:583
299399411,23cyclictest11720-21taskset09:31:583
298099414,10cyclictest25-21ksoftirqd/109:07:211
297699416,9cyclictest9-21ksoftirqd/008:52:210
297699413,9cyclictest9-21ksoftirqd/013:29:490
297699413,4cyclictest9-21ksoftirqd/012:47:270
299399401,23cyclictest5173-21taskset11:54:593
299399400,23cyclictest28841-21taskset13:25:363
298099405,10cyclictest25-21ksoftirqd/108:22:221
297699402,8cyclictest9-21ksoftirqd/008:22:150
297699401,8cyclictest9-21ksoftirqd/012:12:190
106891400,1ptp4l401ktimersoftd/312:08:173
299399390,24cyclictest1678-21/usr/sbin/munin11:17:313
299399390,23cyclictest8717-21ssh11:25:413
299399390,22cyclictest25677-21missed_timers11:42:263
2988993916,10cyclictest33-21ksoftirqd/212:12:202
2980993924,4cyclictest25-21ksoftirqd/108:07:021
297699395,9cyclictest9-21ksoftirqd/008:37:240
297699394,8cyclictest9-21ksoftirqd/010:02:050
106891390,0ptp4l401ktimersoftd/312:59:423
299399381,23cyclictest25721-21taskset09:58:593
299399381,22cyclictest31305-21/usr/sbin/munin13:27:303
299399380,23cyclictest6184-21/usr/sbin/munin08:12:193
106891380,1ptp4l401ktimersoftd/313:18:363
106891380,1ptp4l401ktimersoftd/313:12:593
106891380,1ptp4l401ktimersoftd/312:25:423
106891380,1ptp4l401ktimersoftd/310:50:343
106891380,1ptp4l401ktimersoftd/310:39:043
106891380,1ptp4l401ktimersoftd/310:15:283
299399370,22cyclictest0-21swapper/309:18:333
106891370,1ptp4l401ktimersoftd/312:30:223
106891370,1ptp4l401ktimersoftd/312:19:323
106891370,1ptp4l401ktimersoftd/311:52:013
106891370,1ptp4l401ktimersoftd/311:37:423
106891360,1ptp4l401ktimersoftd/312:51:483
106891360,0ptp4l401ktimersoftd/310:23:323
299399350,20cyclictest11616-21/usr/sbin/munin12:02:283
299399341,26cyclictest28760-21apt-get10:07:173
299399331,24cyclictest27871-21apt-get08:57:153
299399331,24cyclictest18170-21apt-get08:37:153
299399331,24cyclictest13420-21apt-get08:27:143
2993993312,18cyclictest21778-21df09:52:183
21672332,19sleep02244-21ls08:02:300
299399322,22cyclictest2550-21apt-get09:12:153
299399320,21cyclictest22418-21sed10:32:363
299399313,21cyclictest14429-21apt-get09:37:173
299399301,22cyclictest23116-21apt-get08:47:163
2993993010,17cyclictest32198-21taskset09:05:503
299399300,2cyclictest0-21swapper/309:47:523
298899304,14cyclictest20616-21ssh10:32:182
2988993023,4cyclictest33-21ksoftirqd/208:32:032
104472300,3sleep210446-21gltestperf11:27:202
299399298,18cyclictest186292chrt09:44:193
299399292,22cyclictest26278-21apt-get10:02:183
299399291,25cyclictest11365-21tune2fs08:22:173
299399290,25cyclictest20673-21/usr/sbin/munin08:42:143
299399285,20cyclictest3700-21gltestperf08:07:183
299399281,24cyclictest16793-21/usr/sbin/munin08:32:233
299399281,24cyclictest13730-21users09:32:333
299399281,23cyclictest924-21sed09:07:223
2988992822,3cyclictest33-21ksoftirqd/210:12:232
298899264,12cyclictest17831-21ssh11:02:182
298899264,12cyclictest17831-21ssh11:02:182
298899264,11cyclictest5094-21ssh11:22:192
298899263,12cyclictest14842-21ssh11:32:192
2988992622,3cyclictest33-21ksoftirqd/211:47:182
2988992620,3cyclictest33-21ksoftirqd/209:02:152
2988992619,4cyclictest33-21ksoftirqd/213:11:512
2988992619,4cyclictest33-21ksoftirqd/208:22:572
2988992520,3cyclictest33-21ksoftirqd/213:24:272
2988992520,3cyclictest33-21ksoftirqd/212:28:322
2988992519,3cyclictest33-21ksoftirqd/209:51:042
2988992518,4cyclictest33-21ksoftirqd/209:24:512
2988992518,4cyclictest18557-21ssh12:07:502
2988992418,3cyclictest33-21ksoftirqd/212:36:342
2988992418,3cyclictest33-21ksoftirqd/212:20:262
2988992417,4cyclictest33-21ksoftirqd/209:59:402
2988992417,4cyclictest33-21ksoftirqd/209:53:462
2988992417,4cyclictest33-21ksoftirqd/209:28:332
2988992417,4cyclictest33-21ksoftirqd/209:28:332
2988992417,4cyclictest33-21ksoftirqd/208:52:482
2988992417,4cyclictest33-21ksoftirqd/208:47:062
2988992417,4cyclictest33-21ksoftirqd/208:18:232
298899233,2cyclictest121rcu_preempt13:21:042
2988992317,3cyclictest33-21ksoftirqd/210:03:512
2988992317,3cyclictest33-21ksoftirqd/209:33:452
2988992317,3cyclictest33-21ksoftirqd/208:37:502
2988992317,3cyclictest29088-21ptp4l-jitter11:12:292
2988992317,3cyclictest29088-21ptp4l-jitter11:12:292
2988992316,4cyclictest33-21ksoftirqd/209:44:102
2988992316,4cyclictest33-21ksoftirqd/209:01:172
2988992316,4cyclictest33-21ksoftirqd/208:45:412
2988992316,4cyclictest33-21ksoftirqd/208:12:232
298899231,3cyclictest24357-21snmp_o5powerctl11:07:312
298899231,19cyclictest17261-21snmp_o5powerctl10:27:342
2988992217,3cyclictest33-21ksoftirqd/213:02:382
2988992215,4cyclictest33-21ksoftirqd/208:33:172
298899221,18cyclictest3091-21ssh12:58:542
298899216,12cyclictest6734-21if_ens310:17:242
2988992115,3cyclictest33-21ksoftirqd/212:02:452
2988992115,3cyclictest33-21ksoftirqd/211:59:272
2988992115,3cyclictest33-21ksoftirqd/209:39:352
2988992115,3cyclictest33-21ksoftirqd/208:08:472
2988992115,3cyclictest19863-21snmpd10:43:182
2988992114,4cyclictest987-21sshd11:42:312
2988992114,4cyclictest33-21ksoftirqd/209:09:462
2988992114,4cyclictest2671-21tr09:12:162
298899211,17cyclictest7717-21ssh10:52:092
298899211,17cyclictest6448-21sendmail11:57:082
298899211,17cyclictest0-21swapper/212:48:272
298899210,19cyclictest0-21swapper/212:42:172
298899206,11cyclictest3748-21runrttasks13:32:292
2988992016,2cyclictest0-21swapper/213:15:022
2988992014,3cyclictest30540-21sh10:07:342
2988992014,3cyclictest2741-21sh11:18:432
298899201,3cyclictest14974-21ssh10:26:262
2988992013,4cyclictest30331-21ssh12:53:252
2988992013,4cyclictest30331-21ssh12:53:252
2988992013,4cyclictest21350-21cat11:37:352
2988991912,4cyclictest25864-21cut10:37:202
2988991912,4cyclictest15096-21sh10:58:062
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional