You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-24 - 05:31
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackbslot6.osadl.org (updated Tue Mar 24, 2026 00:43:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1068911050,4ptp4l401ktimersoftd/320:02:543
325962760,2sleep30-21swapper/301:33:113
26042670,5sleep1233-21systemd-journal20:16:121
327442630,4sleep2321ktimersoftd/222:15:412
29678996147,7cyclictest33-21ksoftirqd/200:11:302
11732580,2sleep20-21swapper/222:48:412
294562574,10sleep10-21swapper/120:04:441
33312540,2sleep10-21swapper/120:16:281
320782540,4sleep332034-21munin-node20:11:123
292812544,39sleep00-21swapper/020:02:290
295402514,34sleep20-21swapper/220:05:502
121162430,3sleep20-21swapper/222:26:372
121162430,3sleep20-21swapper/222:26:372
106891390,1ptp4l401ktimersoftd/323:34:423
106891390,1ptp4l401ktimersoftd/323:27:153
106891390,1ptp4l401ktimersoftd/322:35:423
106891390,1ptp4l401ktimersoftd/322:25:453
106891390,1ptp4l401ktimersoftd/301:03:053
106891390,0ptp4l401ktimersoftd/323:21:293
2968299382,30cyclictest19512-21ssh23:41:323
2968299381,7cyclictest0-21swapper/300:26:303
29682993813,22cyclictest16327-21sed00:11:193
106891380,1ptp4l401ktimersoftd/323:54:273
106891380,1ptp4l401ktimersoftd/323:47:083
106891380,1ptp4l401ktimersoftd/323:17:393
106891380,1ptp4l401ktimersoftd/323:06:283
106891380,1ptp4l401ktimersoftd/322:49:483
106891380,1ptp4l401ktimersoftd/322:41:473
106891380,1ptp4l401ktimersoftd/301:25:173
106891380,1ptp4l401ktimersoftd/300:56:293
106891380,1ptp4l401ktimersoftd/300:26:123
106891380,1ptp4l401ktimersoftd/300:19:263
106891380,1ptp4l401ktimersoftd/300:09:553
106891380,1ptp4l401ktimersoftd/300:00:063
219702370,2sleep20-21swapper/223:10:492
106891370,1ptp4l401ktimersoftd/323:37:143
106891370,1ptp4l401ktimersoftd/323:12:323
106891370,1ptp4l401ktimersoftd/322:28:143
106891370,1ptp4l401ktimersoftd/322:28:143
106891370,1ptp4l401ktimersoftd/322:16:203
106891370,1ptp4l401ktimersoftd/322:16:103
106891370,1ptp4l401ktimersoftd/322:08:063
106891370,1ptp4l401ktimersoftd/301:26:543
106891370,1ptp4l401ktimersoftd/301:07:093
106891370,1ptp4l401ktimersoftd/300:43:563
106891370,1ptp4l401ktimersoftd/300:33:263
106891370,1ptp4l401ktimersoftd/300:01:523
106891370,0ptp4l401ktimersoftd/320:51:273
2968299362,4cyclictest0-21swapper/322:56:293
106891360,1ptp4l401ktimersoftd/323:02:393
106891360,1ptp4l401ktimersoftd/322:40:073
106891360,1ptp4l401ktimersoftd/300:37:003
106891360,0ptp4l401ktimersoftd/322:51:243
88262340,2sleep00-21swapper/000:02:300
2968299342,27cyclictest18223-21ssh00:46:323
29682993410,21cyclictest23025-21wc20:56:353
106891340,1ptp4l401ktimersoftd/301:18:583
2968299333,26cyclictest40292irq/94-enp1s0-T21:41:293
2968299332,5cyclictest23071-21apt-get00:51:313
29682993312,18cyclictest10566-21awk01:11:343
29682993311,19cyclictest16844-21turbostat20:46:133
29682993311,19cyclictest16844-21turbostat20:46:133
2968299330,5cyclictest29689-21/usr/sbin/munin21:11:293
2968299329,19cyclictest13540-21acpi21:46:283
2968299327,3cyclictest769-21expr20:11:273
2968299321,5cyclictest0-21swapper/321:06:263
2968299321,5cyclictest0-21swapper/320:31:263
74972310,3sleep233-21ksoftirqd/200:35:162
2968299310,10cyclictest3315-21cut20:16:283
136612310,7sleep1241ktimersoftd/101:14:061
2968299308,3cyclictest8839-21processes20:26:343
2968299307,3cyclictest5730-21gltestperf20:21:293
2968299307,3cyclictest4238-21cpuspeed_turbos21:26:293
2968299307,20cyclictest0-21swapper/321:51:283
2968299302,8cyclictest31747-21/usr/sbin/munin21:16:343
29673993017,8cyclictest25-21ksoftirqd/101:21:381
106891300,1ptp4l401ktimersoftd/322:01:313
2968299295,3cyclictest19375-21if_ens321:56:343
2968299290,7cyclictest2525-21irqrtprio21:21:343
29678992923,3cyclictest33-21ksoftirqd/220:36:132
29678992916,6cyclictest33-21ksoftirqd/201:06:332
29667992922,4cyclictest10939-21cron21:41:150
2968299287,3cyclictest18521-21switchtime20:46:403
2968299285,2cyclictest0-21swapper/321:36:283
2968299284,3cyclictest25671-21processes21:01:363
29678992823,3cyclictest33-21ksoftirqd/200:56:192
29678992822,4cyclictest33-21ksoftirqd/221:11:142
2968299274,3cyclictest12780-21fschecks_time20:36:283
2968299274,3cyclictest12780-21fschecks_time20:36:283
2968299273,3cyclictest6720-21cstates21:31:303
29678992722,3cyclictest33-21ksoftirqd/223:28:402
29678992721,4cyclictest33-21ksoftirqd/200:26:442
29678992721,3cyclictest33-21ksoftirqd/223:51:332
29678992721,3cyclictest33-21ksoftirqd/200:36:382
29678992720,4cyclictest33-21ksoftirqd/222:16:252
29678992720,4cyclictest33-21ksoftirqd/220:28:012
29678992720,4cyclictest33-21ksoftirqd/200:08:472
2967899271,20cyclictest16193-21apt-get21:51:282
260562270,2sleep10-21swapper/100:53:461
113602270,3sleep02966799cyclictest20:31:370
29678992621,3cyclictest33-21ksoftirqd/201:23:382
29678992621,3cyclictest33-21ksoftirqd/201:01:342
29678992620,3cyclictest33-21ksoftirqd/200:16:352
29678992620,3cyclictest33-21ksoftirqd/200:02:282
29678992619,4cyclictest8700-21ps22:56:352
29678992619,4cyclictest33-21ksoftirqd/222:04:492
29678992619,4cyclictest33-21ksoftirqd/221:22:372
29678992619,4cyclictest33-21ksoftirqd/220:51:022
29678992619,4cyclictest29876-21grep21:11:302
29673992620,3cyclictest25-21ksoftirqd/120:59:381
29667992619,4cyclictest9-21ksoftirqd/021:50:490
78772250,21sleep07887-21ssh23:28:470
43042250,2sleep10-21swapper/122:18:411
2967899254,3cyclictest121rcu_preempt01:16:132
29678992520,3cyclictest33-21ksoftirqd/223:57:242
29678992520,3cyclictest33-21ksoftirqd/223:46:312
29678992520,3cyclictest33-21ksoftirqd/220:11:122
29678992519,4cyclictest33-21ksoftirqd/222:26:152
29678992519,4cyclictest33-21ksoftirqd/201:17:262
29673992519,4cyclictest25-21ksoftirqd/120:48:201
29673992518,4cyclictest25-21ksoftirqd/123:04:021
29673992518,4cyclictest25-21ksoftirqd/121:13:091
29673992518,4cyclictest25-21ksoftirqd/121:05:301
29667992519,3cyclictest9-21ksoftirqd/020:47:500
29667992518,4cyclictest4070-21ssh22:18:180
175162250,4sleep0101ktimersoftd/000:45:500
29678992419,3cyclictest33-21ksoftirqd/222:36:342
29678992418,3cyclictest33-21ksoftirqd/221:59:052
29678992418,3cyclictest33-21ksoftirqd/220:43:372
29678992418,3cyclictest33-21ksoftirqd/220:43:372
29678992418,3cyclictest33-21ksoftirqd/201:31:382
29678992417,4cyclictest33-21ksoftirqd/221:28:352
29678992417,4cyclictest33-21ksoftirqd/221:17:512
29673992418,4cyclictest25-21ksoftirqd/121:52:431
29673992418,3cyclictest25-21ksoftirqd/123:36:341
29673992417,4cyclictest25-21ksoftirqd/120:42:051
29673992417,4cyclictest25-21ksoftirqd/120:42:051
2967399241,4cyclictest31574-21irqstats22:46:351
29667992419,3cyclictest9-21ksoftirqd/022:11:280
29667992419,3cyclictest9-21ksoftirqd/020:51:260
29667992419,3cyclictest9-21ksoftirqd/020:26:390
29667992419,3cyclictest9-21ksoftirqd/000:31:360
29667992419,3cyclictest30363-21sh01:31:380
29667992418,4cyclictest9-21ksoftirqd/020:21:570
29667992418,3cyclictest9-21ksoftirqd/021:44:030
29667992417,4cyclictest9-21ksoftirqd/020:57:460
2966799241,20cyclictest15679-21apt-get21:51:190
211272240,2sleep00-21swapper/022:36:300
165432241,3sleep116713-21cstates00:11:321
29678992317,4cyclictest33-21ksoftirqd/223:41:392
29678992317,3cyclictest33-21ksoftirqd/220:23:512
29678992317,3cyclictest33-21ksoftirqd/200:24:342
29678992316,4cyclictest33-21ksoftirqd/223:11:472
29678992316,4cyclictest33-21ksoftirqd/221:40:442
29678992316,4cyclictest33-21ksoftirqd/221:03:382
29673992318,3cyclictest25-21ksoftirqd/123:53:081
29673992318,3cyclictest25-21ksoftirqd/122:16:151
29673992318,3cyclictest25-21ksoftirqd/101:31:351
29673992318,3cyclictest25-21ksoftirqd/100:51:191
29673992317,3cyclictest25-21ksoftirqd/121:08:461
29673992317,3cyclictest25-21ksoftirqd/120:38:231
29673992317,3cyclictest25-21ksoftirqd/120:38:231
29673992316,4cyclictest25-21ksoftirqd/121:24:571
2967399231,3cyclictest27722-21ssh01:28:081
2967399231,19cyclictest5451-21users00:31:471
29667992318,3cyclictest9-21ksoftirqd/001:31:190
29667992318,3cyclictest9-21ksoftirqd/001:06:350
29667992317,3cyclictest9-21ksoftirqd/021:32:270
29667992317,3cyclictest9-21ksoftirqd/021:13:420
29667992316,5cyclictest9-21ksoftirqd/021:26:140
29667992316,4cyclictest9-21ksoftirqd/021:19:220
2966799231,4cyclictest31456-21df_inode00:26:330
2966799231,20cyclictest0-21swapper/020:44:340
2966799231,20cyclictest0-21swapper/020:44:340
2966799231,19cyclictest16856-21snmp_o5powerctl01:16:460
29678992217,3cyclictest33-21ksoftirqd/222:51:432
29678992216,3cyclictest33-21ksoftirqd/221:45:252
29678992216,3cyclictest33-21ksoftirqd/220:13:072
29678992215,4cyclictest33-21ksoftirqd/220:58:082
29678992215,4cyclictest33-21ksoftirqd/220:17:382
29678992215,4cyclictest33-21ksoftirqd/200:44:162
2967399228,4cyclictest25-21ksoftirqd/123:59:581
2967399226,4cyclictest18467-21irqrtprio23:06:361
2967399222,17cyclictest20973-21grep22:36:291
29673992216,4cyclictest28748-21phc2sys23:16:391
29673992216,4cyclictest25-21ksoftirqd/120:55:501
29673992216,4cyclictest25-21ksoftirqd/120:23:271
29673992216,4cyclictest25-21ksoftirqd/101:17:311
29673992216,3cyclictest29928-21apt-get20:06:211
29673992216,3cyclictest25-21ksoftirqd/121:46:591
29673992216,3cyclictest25-21ksoftirqd/101:10:531
2967399221,4cyclictest3696-21ssh23:24:561
2967399221,4cyclictest25130-21snmp_o5powerctl22:06:441
29673992214,5cyclictest17091-21strings22:31:351
2967399221,3cyclictest13677-21ssh23:35:261
2967399221,19cyclictest0-21swapper/123:49:221
2967399221,19cyclictest0-21swapper/100:17:071
2967399221,18cyclictest5149-21diskstats23:26:301
2967399221,18cyclictest19300-21ssh23:41:181
2967399221,18cyclictest0-21swapper/121:32:591
2967399220,4cyclictest16107-21runrttasks00:43:191
2967399220,2cyclictest0-21swapper/100:28:471
29667992217,3cyclictest9-21ksoftirqd/023:08:380
29667992217,3cyclictest9-21ksoftirqd/020:08:520
29667992216,4cyclictest9-21ksoftirqd/001:22:080
29667992216,3cyclictest9-21ksoftirqd/023:35:560
29667992216,3cyclictest21006-21idleruntime-cro00:16:180
29667992213,5cyclictest27494-21irqrtprio21:06:330
2966799221,2cyclictest0-21swapper/021:27:390
2966799221,2cyclictest0-21swapper/021:05:180
2966799221,19cyclictest0-21swapper/022:31:080
2966799221,19cyclictest0-21swapper/022:31:080
2966799220,20cyclictest0-21swapper/020:15:530
60682211,16sleep16080-21ssh22:53:431
29678992117,3cyclictest33-21ksoftirqd/221:31:332
29678992116,3cyclictest33-21ksoftirqd/223:06:002
29678992114,4cyclictest28538-21sh22:43:232
29678992114,3cyclictest24658-21latency22:06:362
29673992116,3cyclictest25-21ksoftirqd/120:27:401
2967399211,5cyclictest26212-21/usr/sbin/munin00:21:291
29673992115,3cyclictest25-21ksoftirqd/121:17:281
29673992114,4cyclictest3570-21sh01:03:531
29673992114,4cyclictest25-21ksoftirqd/121:43:001
2967399211,3cyclictest15490-21rm00:10:351
2967399211,18cyclictest31716-21ssh01:00:081
2967399211,18cyclictest10420-21ssh22:57:451
2967399211,17cyclictest10184-21ssh00:04:511
29667992116,3cyclictest9-21ksoftirqd/001:01:400
2966799211,5cyclictest32085-21snmp_o5powerctl22:46:410
29667992115,3cyclictest30173-21sh23:18:060
29667992114,4cyclictest19931-21phc2sys-jitter21:56:370
29667992114,4cyclictest19612-21sendmail_mailtr00:46:430
29667992114,4cyclictest18544-21sh22:32:570
29667992114,4cyclictest14973-21idleruntime-cro01:16:200
2966799211,3cyclictest4200-21ssh23:57:560
2966799211,3cyclictest27175-21snmp_o5powerctl22:41:410
29667992112,5cyclictest22787-21cpuspeed_turbos23:11:310
2966799211,18cyclictest0-21swapper/022:24:160
2966799211,18cyclictest0-21swapper/020:38:460
2966799211,18cyclictest0-21swapper/020:38:460
2966799211,18cyclictest0-21swapper/001:00:160
2966799210,19cyclictest0-21swapper/020:20:290
29678992014,3cyclictest33-21ksoftirqd/221:46:332
29678992014,3cyclictest27872-21/usr/sbin/munin00:56:472
29678992013,4cyclictest3627-21sh23:24:502
29678992013,4cyclictest28342-21sh01:29:112
29678992013,4cyclictest18531-21fschecks_count00:46:352
29678992013,4cyclictest17638-21sh23:38:492
2967399201,4cyclictest22655-21apt-get23:11:291
29673992014,4cyclictest25-21ksoftirqd/121:56:211
29673992014,3cyclictest4383-21sh21:26:291
29673992014,3cyclictest25-21ksoftirqd/120:32:371
29673992014,3cyclictest10950-21munin-plugin-st21:41:151
29673992013,4cyclictest6170-21/usr/sbin/munin22:21:411
29673992013,4cyclictest13111-21sh22:27:041
29673992013,4cyclictest13111-21sh22:27:041
29673992013,4cyclictest10527-21sh00:37:051
2967399200,2cyclictest0-21swapper/122:45:451
2966799205,9cyclictest8007-21ssh22:56:280
29667992015,3cyclictest9-21ksoftirqd/000:23:500
29667992014,3cyclictest9-21ksoftirqd/022:01:540
29667992014,3cyclictest32328-21sh23:21:260
29667992014,3cyclictest18831-21sh23:40:520
29667992013,4cyclictest24857-21tail22:06:380
29667992013,4cyclictest24167-21missed_timers00:51:400
29667992013,4cyclictest23223-21diskmemload00:07:430
2966799201,2cyclictest0-21swapper/023:41:540
2966799201,17cyclictest0-21swapper/023:01:330
2966799201,17cyclictest0-21swapper/000:37:030
2966799201,17cyclictest0-21swapper/000:16:510
2966799201,16cyclictest29180-21apt-get23:51:270
29678991913,3cyclictest31063-21ssh23:19:372
29678991912,4cyclictest9865-21grep23:31:312
29678991912,4cyclictest12633-21expr20:36:262
29678991912,4cyclictest12633-21expr20:36:262
29673991914,3cyclictest21163-21apt-get22:01:281
29667991913,3cyclictest24264-21/usr/sbin/munin23:46:460
2966799191,16cyclictest0-21swapper/022:51:170
29678991812,3cyclictest33-21ksoftirqd/220:53:422
29678991812,3cyclictest15790-21sh22:31:172
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional