You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-01 - 23:54
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot6.osadl.org (updated Thu Jan 01, 2026 12:43:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
733821760,4sleep0165199cyclictest08:36:330
106891990,4ptp4l401ktimersoftd/307:20:223
1668997563,6cyclictest41-21ksoftirqd/309:51:183
1668996555,5cyclictest41-21ksoftirqd/312:46:223
1668996555,5cyclictest41-21ksoftirqd/312:46:223
12272654,10sleep00-21swapper/007:16:550
1668996452,6cyclictest41-21ksoftirqd/308:26:153
1668996452,6cyclictest41-21ksoftirqd/307:56:143
1668996252,4cyclictest41-21ksoftirqd/312:26:203
1668996248,7cyclictest41-21ksoftirqd/312:31:223
195132600,5sleep0165199cyclictest10:16:300
1668995948,5cyclictest41-21ksoftirqd/308:16:143
106891590,1ptp4l401ktimersoftd/310:59:103
302402580,2sleep00-21swapper/009:22:220
106891570,1ptp4l401ktimersoftd/311:36:083
106891550,1ptp4l401ktimersoftd/309:48:283
54312540,2sleep20-21swapper/211:07:022
1668995138,5cyclictest41-21ksoftirqd/310:11:193
276152500,1sleep10-21swapper/112:35:381
1668995023,3cyclictest41-21ksoftirqd/310:01:373
1668994938,5cyclictest41-21ksoftirqd/309:01:173
166099485,12cyclictest904-21ssh12:41:222
1668994738,4cyclictest41-21ksoftirqd/308:51:153
1668994729,10cyclictest41-21ksoftirqd/308:31:323
106891470,1ptp4l401ktimersoftd/312:07:363
87722460,2sleep10-21swapper/107:31:311
323072460,2sleep00-21swapper/009:56:340
1668994637,4cyclictest41-21ksoftirqd/309:21:163
1668994612,4cyclictest41-21ksoftirqd/310:31:263
1668994539,3cyclictest41-21ksoftirqd/308:06:133
131624527,8sleep10-21swapper/107:18:051
1668994420,3cyclictest41-21ksoftirqd/308:56:233
106891440,1ptp4l401ktimersoftd/309:40:423
1668994319,3cyclictest41-21ksoftirqd/309:56:333
1668994234,4cyclictest41-21ksoftirqd/312:11:223
1668994228,11cyclictest41-21ksoftirqd/311:06:233
106891420,0ptp4l401ktimersoftd/310:19:283
106891400,2ptp4l12695-21kworker/3:011:32:013
321672394,21sleep231842-21/usr/sbin/munin07:16:162
1668993932,4cyclictest41-21ksoftirqd/311:11:213
1668993926,3cyclictest41-21ksoftirqd/310:41:063
166899390,3cyclictest121rcu_preempt12:01:313
106891390,2ptp4l20006-21kworker/3:109:42:133
106891390,1ptp4l401ktimersoftd/312:36:133
106891390,1ptp4l401ktimersoftd/311:54:313
1668993810,5cyclictest41-21ksoftirqd/312:45:143
106891380,2ptp4l20006-21kworker/3:111:01:593
106891380,2ptp4l20006-21kworker/3:111:01:593
106891380,1ptp4l401ktimersoftd/310:51:173
106891380,1ptp4l401ktimersoftd/310:22:223
106891380,1ptp4l401ktimersoftd/309:28:553
106891380,0ptp4l401ktimersoftd/311:50:583
1668993732,3cyclictest41-21ksoftirqd/307:26:023
1668993732,3cyclictest41-21ksoftirqd/307:26:023
1668993726,7cyclictest41-21ksoftirqd/311:41:323
1668993714,4cyclictest41-21ksoftirqd/309:06:233
1651993716,4cyclictest9-21ksoftirqd/007:55:580
106891370,1ptp4l401ktimersoftd/312:22:373
106891370,1ptp4l401ktimersoftd/311:56:123
106891370,1ptp4l401ktimersoftd/311:17:543
106891370,1ptp4l401ktimersoftd/309:33:433
106891370,1ptp4l401ktimersoftd/308:36:353
106891360,1ptp4l401ktimersoftd/311:26:013
106891360,1ptp4l401ktimersoftd/310:27:423
106891360,1ptp4l401ktimersoftd/307:41:293
106891360,0ptp4l401ktimersoftd/310:48:533
106891360,0ptp4l401ktimersoftd/310:45:083
166899355,4cyclictest121rcu_preempt10:06:173
1668993525,3cyclictest41-21ksoftirqd/307:31:023
1668993525,3cyclictest41-21ksoftirqd/307:31:023
1668993523,3cyclictest41-21ksoftirqd/307:36:193
54762340,5sleep05471-21munin-run12:46:090
1668993429,3cyclictest41-21ksoftirqd/312:16:203
1668993429,3cyclictest41-21ksoftirqd/307:31:313
1668993425,3cyclictest41-21ksoftirqd/308:46:353
1668993414,7cyclictest41-21ksoftirqd/308:46:033
1668993410,4cyclictest41-21ksoftirqd/311:26:203
166899340,8cyclictest41-21ksoftirqd/308:26:033
106891340,1ptp4l401ktimersoftd/307:46:293
106891320,1ptp4l401ktimersoftd/308:01:173
321342310,2sleep00-21swapper/010:30:190
1668993125,3cyclictest41-21ksoftirqd/309:16:193
1668993125,3cyclictest41-21ksoftirqd/309:16:193
1668993025,3cyclictest41-21ksoftirqd/309:11:263
106891300,1ptp4l401ktimersoftd/308:11:523
1660992823,3cyclictest33-21ksoftirqd/211:15:462
1660992822,3cyclictest33-21ksoftirqd/212:14:152
191772270,2sleep10-21swapper/111:21:271
1668992721,3cyclictest41-21ksoftirqd/307:51:303
1660992721,3cyclictest33-21ksoftirqd/207:43:442
1656992721,3cyclictest25-21ksoftirqd/110:55:331
1651992721,3cyclictest9-21ksoftirqd/009:01:300
1651992721,3cyclictest9-21ksoftirqd/007:34:500
1651992720,4cyclictest9-21ksoftirqd/009:18:520
1651992720,4cyclictest9-21ksoftirqd/009:18:520
268932260,2sleep20-21swapper/212:34:272
1660992620,3cyclictest33-21ksoftirqd/208:08:492
1660992619,4cyclictest33-21ksoftirqd/211:18:272
1660992619,4cyclictest33-21ksoftirqd/208:28:482
1660992617,6cyclictest15538-21sed11:51:092
1660992614,7cyclictest321ktimersoftd/208:31:142
1656992621,3cyclictest25-21ksoftirqd/109:26:191
1656992619,4cyclictest25-21ksoftirqd/108:48:471
1656992619,4cyclictest25-21ksoftirqd/107:59:291
1656992619,4cyclictest25-21ksoftirqd/107:38:491
1656992617,5cyclictest10426-21/usr/sbin/munin09:36:271
1651992621,3cyclictest9-21ksoftirqd/009:38:120
1651992620,3cyclictest9-21ksoftirqd/012:09:310
1651992620,3cyclictest9-21ksoftirqd/008:56:030
1651992620,3cyclictest9-21ksoftirqd/008:04:210
1651992619,4cyclictest9-21ksoftirqd/011:48:520
1651992619,4cyclictest9-21ksoftirqd/011:38:280
299292250,3sleep1231rcuc/109:21:511
1660992520,3cyclictest33-21ksoftirqd/209:36:212
1660992520,3cyclictest33-21ksoftirqd/209:31:212
1660992519,4cyclictest33-21ksoftirqd/208:22:462
1660992519,3cyclictest33-21ksoftirqd/209:16:152
1660992519,3cyclictest33-21ksoftirqd/209:16:152
1660992519,3cyclictest33-21ksoftirqd/208:14:172
1660992518,4cyclictest33-21ksoftirqd/210:24:232
1660992518,4cyclictest33-21ksoftirqd/208:05:562
166099251,3cyclictest121rcu_preempt10:27:092
166099250,3cyclictest121rcu_preempt10:41:142
1656992518,4cyclictest25-21ksoftirqd/109:12:391
1656992518,4cyclictest18171-21grep10:16:181
1656992516,4cyclictest4339-21sh12:11:291
165699250,12cyclictest114742sh12:18:421
256682240,5sleep125673-21cpuspeed_turbos10:56:211
1660992419,3cyclictest33-21ksoftirqd/210:37:092
1660992419,3cyclictest33-21ksoftirqd/209:41:532
1660992419,3cyclictest33-21ksoftirqd/208:56:082
1660992418,3cyclictest33-21ksoftirqd/212:04:522
1660992418,3cyclictest33-21ksoftirqd/209:27:382
1660992417,4cyclictest33-21ksoftirqd/208:41:012
1660992417,4cyclictest33-21ksoftirqd/207:55:162
166099240,2cyclictest121rcu_preempt11:36:302
1656992418,3cyclictest25-21ksoftirqd/108:55:581
1656992417,4cyclictest25-21ksoftirqd/109:00:231
1656992417,4cyclictest25-21ksoftirqd/108:27:231
1656992415,5cyclictest10869-21sh10:08:101
165699241,20cyclictest3552-21ssh10:33:231
1651992419,3cyclictest9-21ksoftirqd/009:16:040
1651992418,3cyclictest9-21ksoftirqd/012:40:070
1651992418,3cyclictest9-21ksoftirqd/008:14:490
1651992418,3cyclictest9-21ksoftirqd/007:23:140
1651992418,3cyclictest9-21ksoftirqd/007:23:140
1651992418,3cyclictest8745-21tail08:41:210
1651992417,4cyclictest9-21ksoftirqd/008:34:440
1651992417,4cyclictest9-21ksoftirqd/008:21:160
1651992417,4cyclictest21248-21latency_hist08:01:030
166099234,16cyclictest29725-21taskset09:55:282
166099233,12cyclictest47150irq/102-ens3-Tx10:51:192
1660992317,3cyclictest33-21ksoftirqd/212:39:082
1660992317,3cyclictest33-21ksoftirqd/208:55:082
1660992317,3cyclictest33-21ksoftirqd/207:36:362
1660992316,4cyclictest33-21ksoftirqd/208:17:322
1660992316,4cyclictest33-21ksoftirqd/207:58:252
1660992316,4cyclictest2911-21idleruntime-cro11:06:072
1660992316,4cyclictest2911-21idleruntime-cro11:06:072
1660992314,5cyclictest21323-21cut09:46:242
1656992318,3cyclictest25-21ksoftirqd/112:31:081
1656992318,3cyclictest25-21ksoftirqd/111:30:161
1656992318,3cyclictest25-21ksoftirqd/109:53:431
1656992317,3cyclictest25-21ksoftirqd/111:46:521
1656992317,3cyclictest25-21ksoftirqd/111:13:361
1656992316,4cyclictest25-21ksoftirqd/108:24:101
1656992316,4cyclictest25-21ksoftirqd/107:22:271
1656992316,4cyclictest25-21ksoftirqd/107:22:271
1656992316,4cyclictest15686-21tr09:41:201
1656992314,6cyclictest26607-21cpuspeed_turbos08:11:161
1656992314,4cyclictest0-21swapper/111:36:201
165699231,19cyclictest5501-21apt-get09:31:171
165699231,19cyclictest4943-21snmp_o5powerctl08:31:281
1651992317,3cyclictest9-21ksoftirqd/009:27:440
1651992316,4cyclictest9-21ksoftirqd/009:10:460
1651992316,4cyclictest8723-21cut12:16:250
165199231,19cyclictest14563-21snmp_o5powerctl10:11:340
3028222215,3sleep125-21ksoftirqd/112:06:001
1660992216,3cyclictest33-21ksoftirqd/212:28:242
1660992216,3cyclictest33-21ksoftirqd/210:47:502
1660992215,5cyclictest33-21ksoftirqd/211:31:312
1660992215,4cyclictest33-21ksoftirqd/210:57:152
1660992215,4cyclictest33-21ksoftirqd/210:15:392
1660992215,4cyclictest33-21ksoftirqd/207:25:092
1660992215,4cyclictest33-21ksoftirqd/207:25:092
1660992212,7cyclictest16509-21irqrtprio11:51:282
1656992217,3cyclictest25-21ksoftirqd/111:07:081
1656992216,3cyclictest25-21ksoftirqd/108:16:471
1656992215,4cyclictest25-21ksoftirqd/108:41:161
165699221,4cyclictest17299-21ssh12:25:071
1656992214,5cyclictest31647-21strings09:56:251
165699221,3cyclictest0-21swapper/107:46:271
1651992217,3cyclictest9-21ksoftirqd/011:29:040
1651992216,3cyclictest9-21ksoftirqd/012:32:160
1651992215,4cyclictest46950irq/100-ens3-Tx11:21:080
165199221,18cyclictest23592-21/usr/sbin/munin10:21:230
166099212,13cyclictest5880-21apt-get12:46:232
166099212,13cyclictest5880-21apt-get12:46:232
166099212,12cyclictest47150irq/102-ens3-Tx10:06:172
1660992114,4cyclictest33-21ksoftirqd/209:11:162
1660992114,4cyclictest33-21ksoftirqd/209:08:232
1660992114,4cyclictest33-21ksoftirqd/207:27:382
1660992114,4cyclictest33-21ksoftirqd/207:27:382
1660992114,4cyclictest18327-21sh10:16:192
166099210,6cyclictest0-21swapper/211:56:262
165699214,15cyclictest25-21ksoftirqd/111:52:211
1656992116,3cyclictest0-21swapper/107:30:551
1656992116,3cyclictest0-21swapper/107:30:551
1656992114,4cyclictest32603-21sh10:31:051
165699211,3cyclictest32753-21ssh12:06:491
1656992113,5cyclictest23986-21cut10:21:251
1656992113,4cyclictest25-21ksoftirqd/108:01:131
1656992113,4cyclictest13642-21fschecks_count11:16:231
165699211,17cyclictest6421-21cut08:36:211
165699211,17cyclictest29293-21memory11:31:281
165699210,19cyclictest0-21swapper/107:41:471
165199211,9cyclictest25542-21bc10:56:190
1651992116,3cyclictest9-21ksoftirqd/011:12:570
1651992115,4cyclictest9-21ksoftirqd/008:28:540
1651992115,4cyclictest9-21ksoftirqd/007:44:180
165199211,4cyclictest16801-21irqstats08:56:240
1651992114,4cyclictest9-21ksoftirqd/009:49:040
1651992114,4cyclictest27482-21diskmemload11:06:140
165199210,3cyclictest9155-21missed_timers10:06:260
165199210,18cyclictest27482-21diskmemload09:34:010
186982200,5sleep2166099cyclictest11:21:242
1660992015,3cyclictest33-21ksoftirqd/208:50:242
1660992014,3cyclictest1587-21sh12:08:542
1660992013,4cyclictest8206-21sh12:16:102
1660992013,4cyclictest7569-21sh10:05:572
1660992013,4cyclictest33-21ksoftirqd/207:35:252
1660992013,4cyclictest32718-21sh09:57:092
1660992013,4cyclictest25725-21sh11:27:402
1660992013,4cyclictest15615-21sh12:22:192
166099201,17cyclictest8732-21ssh11:43:242
166099201,17cyclictest0-21swapper/209:22:012
166099201,16cyclictest18290-21apt-get09:01:172
166099200,18cyclictest0-21swapper/207:46:312
1656992016,2cyclictest0-21swapper/109:08:091
1656992015,3cyclictest0-21swapper/110:12:181
1656992014,3cyclictest22639-21uptime11:56:391
1656992014,3cyclictest18449-21ssh10:48:191
1656992014,3cyclictest1467-21if_enp1s012:41:271
1656992013,4cyclictest9220-21sh10:39:321
1656992013,4cyclictest7396-21sh12:46:391
1656992013,4cyclictest7396-21sh12:46:391
1656992013,4cyclictest25-21ksoftirqd/108:06:071
1656992013,4cyclictest20785-21df_inode09:46:201
165699201,17cyclictest0-21swapper/112:37:081
165699201,17cyclictest0-21swapper/111:41:201
165699201,16cyclictest27482-21diskmemload11:03:061
165699201,16cyclictest27482-21diskmemload11:03:061
165699200,18cyclictest0-21swapper/109:17:371
165699200,18cyclictest0-21swapper/109:17:371
165199208,3cyclictest9-21ksoftirqd/009:55:470
165199202,16cyclictest0-21swapper/010:53:180
165199202,15cyclictest10534-21cat12:51:090
165199202,15cyclictest10534-21cat12:51:090
1651992015,3cyclictest9-21ksoftirqd/011:54:500
1651992015,3cyclictest9-21ksoftirqd/011:24:310
1651992015,3cyclictest9-21ksoftirqd/008:47:140
1651992015,3cyclictest9-21ksoftirqd/007:28:440
1651992015,3cyclictest9-21ksoftirqd/007:28:440
1651992014,3cyclictest9-21ksoftirqd/011:56:110
1651992013,4cyclictest25727-21/usr/sbin/munin12:01:340
1651992013,4cyclictest13561-21cstates12:21:240
165199201,17cyclictest0-21swapper/011:35:080
165199201,17cyclictest0-21swapper/009:41:340
165199201,16cyclictest640-21ssh10:31:220
165199200,17cyclictest12570-21ssh10:41:490
166099191,4cyclictest928-21diskstats10:31:242
1660991913,3cyclictest8257-21/usr/sbin/munin08:41:272
1656991915,2cyclictest0-21swapper/109:02:371
1656991912,4cyclictest12003-21which10:41:321
165699191,15cyclictest16898-21cpuspeed_turbos07:51:141
1651991913,3cyclictest9-21ksoftirqd/008:17:060
1651991913,3cyclictest8633-21sh11:43:140
1651991913,3cyclictest20222-21wc10:51:060
1651991912,4cyclictest4974-21timedrift12:11:390
1651991912,4cyclictest27482-21diskmemload10:36:430
165199191,16cyclictest0-21swapper/012:27:170
165199191,15cyclictest14429-21apt-get07:46:150
165199191,15cyclictest0-21swapper/011:02:320
165199191,15cyclictest0-21swapper/011:02:320
165199190,3cyclictest4482-21readlink10:01:300
1656991811,4cyclictest3534-21grep10:01:231
165199180,2cyclictest0-21swapper/007:36:470
165199171,14cyclictest0-21swapper/008:10:100
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional