You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-09 - 03:09
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot6.osadl.org (updated Sun Nov 09, 2025 00:43:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2342221580,5sleep0192699cyclictest00:30:370
1205421360,5sleep3194799cyclictest00:19:283
1773911000,4ptp4l401ktimersoftd/320:08:593
13272640,1sleep10-21swapper/122:15:281
1939996250,6cyclictest33-21ksoftirqd/223:35:212
177442600,2sleep10-21swapper/120:40:221
268432550,4sleep026847-21ptp4l22:05:280
19672530,4sleep341-21ksoftirqd/300:43:493
14552514,34sleep20-21swapper/220:05:372
55312500,2sleep00-21swapper/001:25:250
55312500,2sleep00-21swapper/001:25:250
273962500,2sleep20-21swapper/201:11:502
1947995010,6cyclictest41-21ksoftirqd/322:11:203
16842504,33sleep10-21swapper/120:08:261
194799484,8cyclictest20432-21sed23:50:363
194799477,5cyclictest41-21ksoftirqd/301:25:103
194799477,5cyclictest41-21ksoftirqd/301:25:103
194799475,7cyclictest16888-21sed20:40:033
1939994529,8cyclictest33-21ksoftirqd/201:25:232
1939994529,8cyclictest33-21ksoftirqd/201:25:232
194799437,5cyclictest41-21ksoftirqd/300:00:423
194799437,15cyclictest21412-21sh00:30:023
194799426,5cyclictest41-21ksoftirqd/323:32:433
194799418,5cyclictest41-21ksoftirqd/322:15:473
194799417,4cyclictest41-21ksoftirqd/300:12:053
194799415,7cyclictest21072-21awk20:45:323
1947994111,5cyclictest41-21ksoftirqd/322:23:413
194799407,5cyclictest41-21ksoftirqd/323:27:313
194799407,5cyclictest41-21ksoftirqd/322:58:213
194799407,5cyclictest41-21ksoftirqd/300:07:503
194799407,4cyclictest41-21ksoftirqd/300:50:543
194799406,5cyclictest41-21ksoftirqd/323:59:283
194799406,5cyclictest41-21ksoftirqd/322:50:583
194799406,5cyclictest41-21ksoftirqd/300:23:133
194799405,5cyclictest41-21ksoftirqd/301:08:493
194799398,5cyclictest41-21ksoftirqd/323:01:173
194799397,6cyclictest41-21ksoftirqd/322:37:103
194799396,5cyclictest41-21ksoftirqd/323:36:073
194799396,5cyclictest41-21ksoftirqd/323:05:583
194799396,5cyclictest41-21ksoftirqd/301:38:413
194799396,5cyclictest41-21ksoftirqd/301:33:053
194799396,5cyclictest41-21ksoftirqd/301:01:113
194799395,5cyclictest41-21ksoftirqd/322:46:133
194799395,5cyclictest41-21ksoftirqd/301:21:143
194799395,5cyclictest41-21ksoftirqd/300:46:133
194799388,5cyclictest41-21ksoftirqd/323:40:073
194799388,5cyclictest41-21ksoftirqd/323:40:073
194799388,5cyclictest41-21ksoftirqd/300:30:153
194799387,4cyclictest41-21ksoftirqd/322:31:193
194799385,5cyclictest41-21ksoftirqd/323:23:583
194799385,5cyclictest41-21ksoftirqd/322:27:013
194799385,5cyclictest41-21ksoftirqd/301:19:383
194799385,5cyclictest41-21ksoftirqd/300:36:243
177391380,1ptp4l401ktimersoftd/323:19:093
177391380,1ptp4l401ktimersoftd/323:11:073
177391380,1ptp4l401ktimersoftd/301:13:533
194799375,5cyclictest41-21ksoftirqd/322:40:153
194799368,5cyclictest41-21ksoftirqd/321:50:293
194799367,5cyclictest41-21ksoftirqd/321:45:333
1947993616,9cyclictest41-21ksoftirqd/321:00:253
177391360,1ptp4l401ktimersoftd/321:15:243
177391360,0ptp4l401ktimersoftd/323:48:183
1939993522,7cyclictest33-21ksoftirqd/223:55:192
177391350,0ptp4l401ktimersoftd/320:19:223
177391350,0ptp4l401ktimersoftd/320:19:223
177391350,0ptp4l401ktimersoftd/300:55:483
1926993419,4cyclictest9-21ksoftirqd/022:28:120
61922330,5sleep16198-21irqrtprio01:25:301
61922330,5sleep16198-21irqrtprio01:25:301
194799339,5cyclictest41-21ksoftirqd/321:36:163
194799338,5cyclictest41-21ksoftirqd/320:31:203
1926993320,4cyclictest9-21ksoftirqd/020:20:250
1939993226,3cyclictest33-21ksoftirqd/221:20:192
1939993119,9cyclictest33-21ksoftirqd/222:15:252
193999310,3cyclictest121rcu_preempt23:20:542
1926993126,3cyclictest9-21ksoftirqd/021:20:040
177391310,0ptp4l401ktimersoftd/321:28:103
7942306,10sleep00-21swapper/020:05:270
31212300,2sleep00-21swapper/020:10:220
31212300,2sleep00-21swapper/020:10:220
1947993025,3cyclictest391rcuc/322:05:353
193999304,6cyclictest121rcu_preempt00:15:232
1939993025,3cyclictest33-21ksoftirqd/221:25:252
1939993025,3cyclictest33-21ksoftirqd/221:20:042
1939993025,3cyclictest33-21ksoftirqd/220:20:232
1939993025,3cyclictest33-21ksoftirqd/200:10:072
1939993024,3cyclictest33-21ksoftirqd/223:00:062
193199305,22cyclictest1968-21ssh00:43:491
194799299,11cyclictest41-21ksoftirqd/320:50:463
1939992924,3cyclictest33-21ksoftirqd/222:35:252
1939992924,3cyclictest33-21ksoftirqd/222:10:052
1939992924,3cyclictest33-21ksoftirqd/200:45:262
1939992923,3cyclictest33-21ksoftirqd/223:45:252
193999292,21cyclictest0-21swapper/200:30:212
193199298,9cyclictest0-21swapper/100:25:211
1931992921,6cyclictest25-21ksoftirqd/100:02:591
193199290,3cyclictest121rcu_preempt20:20:251
1926992924,3cyclictest9-21ksoftirqd/023:30:070
1926992922,4cyclictest9-21ksoftirqd/022:37:390
194799287,6cyclictest41-21ksoftirqd/321:59:393
194799286,8cyclictest41-21ksoftirqd/321:41:203
194799285,7cyclictest41-21ksoftirqd/320:43:263
194799283,5cyclictest41-21ksoftirqd/321:24:253
1947992810,7cyclictest41-21ksoftirqd/321:11:313
1939992823,3cyclictest33-21ksoftirqd/223:10:072
1939992823,3cyclictest33-21ksoftirqd/222:25:252
1939992823,3cyclictest33-21ksoftirqd/200:50:262
1939992822,3cyclictest33-21ksoftirqd/220:50:182
1939992822,3cyclictest33-21ksoftirqd/201:00:262
1939992821,4cyclictest33-21ksoftirqd/221:43:502
1939992818,5cyclictest33-21ksoftirqd/201:05:212
1931992823,3cyclictest25-21ksoftirqd/101:20:101
1931992821,4cyclictest25-21ksoftirqd/121:22:451
1926992823,3cyclictest9-21ksoftirqd/023:25:070
1926992823,3cyclictest9-21ksoftirqd/021:33:520
194799275,8cyclictest41-21ksoftirqd/320:25:283
1939992722,3cyclictest33-21ksoftirqd/220:15:022
1939992722,3cyclictest33-21ksoftirqd/220:15:022
1939992722,3cyclictest33-21ksoftirqd/200:35:282
1939992722,3cyclictest33-21ksoftirqd/200:20:282
1939992721,3cyclictest33-21ksoftirqd/222:20:342
1939992721,3cyclictest33-21ksoftirqd/200:25:462
1939992720,4cyclictest33-21ksoftirqd/220:18:192
1939992720,4cyclictest33-21ksoftirqd/220:18:192
1931992721,3cyclictest25-21ksoftirqd/122:23:541
1931992720,4cyclictest25-21ksoftirqd/121:58:261
1931992720,4cyclictest25-21ksoftirqd/121:17:231
1931992720,4cyclictest25-21ksoftirqd/121:03:421
1931992720,4cyclictest25-21ksoftirqd/120:56:561
1931992720,4cyclictest25-21ksoftirqd/120:27:411
1926992722,3cyclictest9-21ksoftirqd/022:50:370
1926992722,3cyclictest9-21ksoftirqd/001:10:080
1926992722,3cyclictest9-21ksoftirqd/001:00:080
1926992722,3cyclictest9-21ksoftirqd/000:00:070
1926992721,3cyclictest9-21ksoftirqd/021:20:070
1926992721,3cyclictest9-21ksoftirqd/021:07:100
1926992721,3cyclictest9-21ksoftirqd/020:50:150
1926992721,3cyclictest9-21ksoftirqd/020:40:030
232942260,2sleep3391rcuc/322:00:173
199132260,2sleep1193199cyclictest23:15:061
194799266,10cyclictest41-21ksoftirqd/321:05:203
1939992621,3cyclictest33-21ksoftirqd/223:40:252
1939992621,3cyclictest33-21ksoftirqd/223:40:252
1939992621,3cyclictest33-21ksoftirqd/223:15:062
1939992621,3cyclictest33-21ksoftirqd/200:55:252
1939992620,3cyclictest33-21ksoftirqd/223:15:232
1939992620,3cyclictest33-21ksoftirqd/221:30:432
1939992619,4cyclictest33-21ksoftirqd/222:04:372
1939992619,4cyclictest33-21ksoftirqd/221:50:402
1939992619,4cyclictest33-21ksoftirqd/221:11:142
1931992621,3cyclictest25-21ksoftirqd/123:40:141
1931992621,3cyclictest25-21ksoftirqd/123:40:141
1931992621,3cyclictest25-21ksoftirqd/121:50:271
1931992621,3cyclictest25-21ksoftirqd/101:10:321
1931992621,3cyclictest25-21ksoftirqd/100:50:251
1931992620,3cyclictest25-21ksoftirqd/123:55:291
1931992620,3cyclictest25-21ksoftirqd/101:05:561
1931992620,3cyclictest25-21ksoftirqd/101:05:081
1931992619,4cyclictest25-21ksoftirqd/123:50:511
1931992619,4cyclictest25-21ksoftirqd/121:41:361
1931992619,4cyclictest25-21ksoftirqd/120:38:251
193199260,3cyclictest121rcu_preempt22:28:121
1926992621,3cyclictest9-21ksoftirqd/022:40:190
1926992621,3cyclictest9-21ksoftirqd/000:46:310
1926992621,3cyclictest9-21ksoftirqd/000:21:340
1926992620,4cyclictest9-21ksoftirqd/023:11:120
1926992620,3cyclictest9-21ksoftirqd/022:20:050
1926992620,3cyclictest9-21ksoftirqd/021:51:020
1926992619,4cyclictest9-21ksoftirqd/023:35:370
240852250,3sleep1241ktimersoftd/120:55:031
194799259,7cyclictest41-21ksoftirqd/320:55:343
194799257,5cyclictest41-21ksoftirqd/320:14:053
194799257,5cyclictest41-21ksoftirqd/320:14:053
194799253,6cyclictest41-21ksoftirqd/320:20:333
1939992521,2cyclictest33-21ksoftirqd/221:00:032
1939992520,3cyclictest33-21ksoftirqd/221:45:182
1939992520,3cyclictest33-21ksoftirqd/200:40:282
1939992519,3cyclictest33-21ksoftirqd/220:25:212
1939992518,5cyclictest33-21ksoftirqd/220:45:212
1939992518,4cyclictest33-21ksoftirqd/201:31:462
1939992514,6cyclictest33-21ksoftirqd/201:35:232
1931992520,3cyclictest25-21ksoftirqd/123:35:241
1931992520,3cyclictest25-21ksoftirqd/123:25:071
1931992520,3cyclictest25-21ksoftirqd/123:05:261
1931992520,3cyclictest25-21ksoftirqd/121:30:271
1931992519,3cyclictest25-21ksoftirqd/122:40:051
1931992519,3cyclictest25-21ksoftirqd/120:50:031
1931992518,5cyclictest22039-21grep23:15:401
1931992518,4cyclictest25-21ksoftirqd/122:09:301
1931992518,4cyclictest25-21ksoftirqd/120:14:401
1931992518,4cyclictest25-21ksoftirqd/120:14:401
1926992520,3cyclictest9-21ksoftirqd/000:25:240
1926992519,3cyclictest9-21ksoftirqd/022:01:020
1926992519,3cyclictest9-21ksoftirqd/021:03:130
1926992519,3cyclictest9-21ksoftirqd/020:43:080
1926992518,4cyclictest9-21ksoftirqd/022:00:040
1926992518,4cyclictest9-21ksoftirqd/021:14:010
177391250,1ptp4l401ktimersoftd/321:30:213
1939992419,3cyclictest33-21ksoftirqd/223:55:072
1939992418,4cyclictest33-21ksoftirqd/221:07:372
1931992418,4cyclictest25-21ksoftirqd/120:15:051
1931992418,4cyclictest25-21ksoftirqd/120:15:051
1931992418,3cyclictest25-21ksoftirqd/101:37:141
1931992417,4cyclictest25-21ksoftirqd/122:54:591
1926992418,3cyclictest9-21ksoftirqd/020:20:010
1926992418,3cyclictest9-21ksoftirqd/020:20:010
1926992417,4cyclictest9-21ksoftirqd/020:32:300
1939992318,3cyclictest33-21ksoftirqd/223:00:262
1939992318,3cyclictest33-21ksoftirqd/222:50:262
1939992318,3cyclictest33-21ksoftirqd/222:45:252
1939992318,3cyclictest33-21ksoftirqd/201:24:312
1939992317,4cyclictest33-21ksoftirqd/223:26:272
1939992317,3cyclictest33-21ksoftirqd/221:02:012
1939992316,4cyclictest28296-21grep00:00:262
193999231,18cyclictest5294-21snmp_o5powerctl00:10:382
1931992318,3cyclictest25-21ksoftirqd/123:00:361
1931992318,3cyclictest25-21ksoftirqd/122:55:321
1931992318,3cyclictest25-21ksoftirqd/121:35:281
1931992318,3cyclictest25-21ksoftirqd/120:30:241
1931992318,3cyclictest25-21ksoftirqd/100:55:271
1931992316,5cyclictest25-21ksoftirqd/100:45:281
1926992317,3cyclictest9-21ksoftirqd/020:48:400
1926992317,3cyclictest9-21ksoftirqd/000:11:490
1926992316,4cyclictest9-21ksoftirqd/022:48:390
1926992316,4cyclictest9-21ksoftirqd/020:57:550
1939992217,3cyclictest33-21ksoftirqd/222:30:252
1939992216,3cyclictest33-21ksoftirqd/221:37:212
1931992217,3cyclictest25-21ksoftirqd/123:30:071
1931992217,3cyclictest25-21ksoftirqd/122:49:331
1931992217,3cyclictest25-21ksoftirqd/100:25:081
1931992216,3cyclictest25-21ksoftirqd/123:48:211
1931992216,3cyclictest25-21ksoftirqd/122:31:381
1931992216,3cyclictest25-21ksoftirqd/121:28:421
1931992216,3cyclictest25-21ksoftirqd/100:36:181
1931992215,4cyclictest25-21ksoftirqd/121:45:371
1926992217,3cyclictest9-21ksoftirqd/023:45:360
1926992217,3cyclictest9-21ksoftirqd/021:28:060
1926992217,3cyclictest9-21ksoftirqd/001:01:240
1926992216,3cyclictest12401-21latency_hist00:20:080
193999219,9cyclictest33-21ksoftirqd/222:10:352
1939992116,3cyclictest33-21ksoftirqd/220:40:162
1939992113,5cyclictest30878-21timerwakeupswit01:15:392
193999211,17cyclictest2457-21needreboot23:30:282
1931992116,3cyclictest25-21ksoftirqd/101:33:581
1931992114,4cyclictest8248-21/usr/sbin/munin00:15:271
1931992114,4cyclictest25-21ksoftirqd/121:09:201
1931992114,4cyclictest23232-21mailstats00:30:321
1931992113,4cyclictest7936-21sh00:15:081
192699218,4cyclictest9-21ksoftirqd/000:08:370
1926992115,4cyclictest9-21ksoftirqd/000:53:340
1926992115,3cyclictest9-21ksoftirqd/001:13:530
1926992114,4cyclictest9-21ksoftirqd/021:38:580
1926992114,4cyclictest9-21ksoftirqd/000:01:540
1926992114,4cyclictest7292-21fschecks_count23:00:230
1926992114,4cyclictest30604-21sendmail_mailtr01:15:330
1926992114,4cyclictest13083-21/usr/sbin/munin01:35:410
1939992014,3cyclictest33-21ksoftirqd/220:35:262
1939992013,4cyclictest23928-21sh22:41:052
1939992013,4cyclictest20941-21cat21:55:182
1939992013,4cyclictest13266-21sed20:30:252
1931992015,3cyclictest25-21ksoftirqd/122:10:291
1931992015,3cyclictest25-21ksoftirqd/122:03:361
1931992013,4cyclictest25-21ksoftirqd/101:15:211
1931992013,4cyclictest1358-21cpu23:30:201
1931992012,5cyclictest22285-21fschecks_time22:40:231
192699204,8cyclictest1760-21runrttasks23:16:220
1926992015,3cyclictest9-21ksoftirqd/022:10:220
1926992014,4cyclictest9-21ksoftirqd/001:30:240
1926992014,3cyclictest9-21ksoftirqd/023:42:310
1926992014,3cyclictest9-21ksoftirqd/023:42:310
1926992014,3cyclictest19407-21if_ens323:50:250
1926992014,3cyclictest1547-21ls01:20:220
1926992013,4cyclictest6603-21idleruntime-cro23:00:060
1926992013,4cyclictest26307-21/usr/sbin/munin00:35:310
193199191,3cyclictest121rcu_preempt00:05:211
192699194,7cyclictest0-21swapper/022:32:380
1926991914,3cyclictest9-21ksoftirqd/000:40:220
1926991913,4cyclictest16058-21/usr/sbin/munin21:45:170
1926991913,3cyclictest9-21ksoftirqd/021:40:240
1926991913,3cyclictest11450-21cpuspeed_turbos23:05:210
1926991912,4cyclictest28716-21date23:25:060
1926991912,4cyclictest10597-21if_err_ens320:25:230
1931991811,4cyclictest31691-21bc21:10:161
1926991812,4cyclictest27682-21diskmemload22:23:260
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional