You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-08-21 - 22:16
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackbslot6.osadl.org (updated Thu Aug 21, 2025 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3250821740,5sleep21866699cyclictest11:11:192
98421630,4sleep31867199cyclictest10:31:223
1762521130,3sleep00-21swapper/007:21:230
177391960,4ptp4l401ktimersoftd/307:23:243
38352690,3sleep31867199cyclictest11:16:063
324842690,5sleep11866199cyclictest11:50:531
324842690,5sleep11866199cyclictest11:50:531
18654996932,5cyclictest9-21ksoftirqd/012:16:220
183752694,10sleep20-21swapper/207:23:402
181292680,1sleep00-21swapper/009:31:330
177391680,1ptp4l401ktimersoftd/310:56:563
311862630,2sleep10-21swapper/110:27:381
177391630,1ptp4l401ktimersoftd/311:26:203
68852610,1sleep00-21swapper/011:19:080
177391600,1ptp4l401ktimersoftd/309:55:083
177391600,1ptp4l401ktimersoftd/309:09:573
18654995929,4cyclictest9-21ksoftirqd/009:31:040
177391590,1ptp4l401ktimersoftd/312:22:463
319392580,2sleep30-21swapper/309:50:153
18661995724,3cyclictest25-21ksoftirqd/109:26:231
177391570,1ptp4l401ktimersoftd/307:44:553
18661995627,4cyclictest25-21ksoftirqd/107:31:001
18654995628,4cyclictest9-21ksoftirqd/007:41:210
177391560,1ptp4l401ktimersoftd/309:26:193
177391550,1ptp4l401ktimersoftd/310:01:213
177391550,1ptp4l401ktimersoftd/310:01:213
146922550,1sleep10-21swapper/112:06:271
270242540,5sleep01865499cyclictest12:53:350
18661995427,4cyclictest25-21ksoftirqd/110:41:231
18661995426,4cyclictest25-21ksoftirqd/108:06:001
18654995428,4cyclictest9-21ksoftirqd/009:36:330
18654995427,4cyclictest9-21ksoftirqd/010:36:040
18654995426,4cyclictest9-21ksoftirqd/012:26:070
18661995325,4cyclictest25-21ksoftirqd/111:11:061
18654995326,4cyclictest9-21ksoftirqd/011:46:220
18654995326,4cyclictest9-21ksoftirqd/011:46:220
18654995325,13cyclictest9-21ksoftirqd/010:21:330
18661995227,3cyclictest25-21ksoftirqd/112:11:261
18661995226,4cyclictest25-21ksoftirqd/108:36:241
18661995225,4cyclictest25-21ksoftirqd/111:41:321
18661995224,3cyclictest25-21ksoftirqd/109:26:031
18654995225,3cyclictest9-21ksoftirqd/010:41:200
18661995125,4cyclictest25-21ksoftirqd/111:26:211
18661995125,4cyclictest25-21ksoftirqd/109:47:231
18661995124,4cyclictest25-21ksoftirqd/109:56:231
18661995121,7cyclictest25-21ksoftirqd/109:40:231
18654995125,3cyclictest9-21ksoftirqd/010:51:260
18654995124,4cyclictest9-21ksoftirqd/011:56:260
18654995124,4cyclictest9-21ksoftirqd/011:36:060
18654995124,4cyclictest9-21ksoftirqd/008:36:020
18654995124,4cyclictest9-21ksoftirqd/007:56:310
18654995124,3cyclictest9-21ksoftirqd/011:01:230
18661995024,6cyclictest25-21ksoftirqd/111:16:221
18661995024,4cyclictest25-21ksoftirqd/111:01:251
18661995023,4cyclictest25-21ksoftirqd/108:16:331
18661995022,4cyclictest25-21ksoftirqd/110:36:231
18661995022,4cyclictest25-21ksoftirqd/110:21:241
18654995026,3cyclictest9-21ksoftirqd/008:21:230
18654995026,3cyclictest9-21ksoftirqd/008:21:230
18654995024,4cyclictest9-21ksoftirqd/009:41:280
18654995024,4cyclictest9-21ksoftirqd/007:26:230
18654995023,4cyclictest9-21ksoftirqd/009:06:030
18654995023,4cyclictest9-21ksoftirqd/008:41:250
18654995022,4cyclictest9-21ksoftirqd/009:06:250
18654995020,4cyclictest9-21ksoftirqd/012:14:270
18661994924,3cyclictest25-21ksoftirqd/108:06:201
18661994923,4cyclictest25-21ksoftirqd/112:52:491
18661994923,4cyclictest25-21ksoftirqd/108:26:201
18661994922,4cyclictest25-21ksoftirqd/112:46:301
18661994922,4cyclictest25-21ksoftirqd/112:31:201
18661994922,4cyclictest25-21ksoftirqd/111:56:291
18661994921,4cyclictest25-21ksoftirqd/110:56:211
18654994925,3cyclictest9-21ksoftirqd/007:36:190
18654994924,4cyclictest9-21ksoftirqd/008:01:190
18654994924,3cyclictest9-21ksoftirqd/008:16:170
18654994923,3cyclictest9-21ksoftirqd/011:51:270
18654994923,3cyclictest9-21ksoftirqd/011:51:270
18654994923,3cyclictest9-21ksoftirqd/010:36:210
18654994923,3cyclictest9-21ksoftirqd/009:21:170
18654994923,3cyclictest9-21ksoftirqd/007:31:170
18654994922,4cyclictest9-21ksoftirqd/011:06:290
18654994922,4cyclictest9-21ksoftirqd/007:51:210
18654994920,4cyclictest9-21ksoftirqd/012:36:080
18661994822,4cyclictest25-21ksoftirqd/110:51:251
18654994832,8cyclictest9-21ksoftirqd/010:26:350
18654994824,3cyclictest9-21ksoftirqd/008:51:210
18654994824,3cyclictest9-21ksoftirqd/008:46:140
18654994823,4cyclictest9-21ksoftirqd/012:46:310
18654994823,4cyclictest9-21ksoftirqd/009:11:220
18654994823,3cyclictest9-21ksoftirqd/010:46:290
18654994822,3cyclictest9-21ksoftirqd/010:01:230
18654994822,3cyclictest9-21ksoftirqd/010:01:230
18671994732,9cyclictest41-21ksoftirqd/312:16:223
18661994723,3cyclictest25-21ksoftirqd/112:01:171
18661994723,3cyclictest25-21ksoftirqd/111:52:401
18661994723,3cyclictest25-21ksoftirqd/111:52:401
18661994723,3cyclictest25-21ksoftirqd/110:46:221
18661994722,3cyclictest25-21ksoftirqd/108:31:171
18661994721,4cyclictest25-21ksoftirqd/112:41:221
18661994721,4cyclictest25-21ksoftirqd/112:36:311
18661994721,4cyclictest25-21ksoftirqd/108:21:161
18661994721,4cyclictest25-21ksoftirqd/108:21:161
18661994720,4cyclictest25-21ksoftirqd/108:11:151
18661994719,5cyclictest25-21ksoftirqd/109:06:241
18654994723,4cyclictest9-21ksoftirqd/008:56:260
18654994721,4cyclictest9-21ksoftirqd/012:26:280
18654994721,4cyclictest9-21ksoftirqd/008:31:010
18654994719,4cyclictest9-21ksoftirqd/012:41:290
177391470,2ptp4l23922-21kworker/3:109:01:013
18661994621,4cyclictest25-21ksoftirqd/109:51:181
18661994620,4cyclictest25-21ksoftirqd/109:33:391
18661994619,4cyclictest25-21ksoftirqd/111:34:041
18661994619,4cyclictest25-21ksoftirqd/111:21:291
18654994627,16cyclictest9-21ksoftirqd/011:41:280
18654994622,3cyclictest9-21ksoftirqd/010:56:190
18654994621,3cyclictest9-21ksoftirqd/008:06:300
18661994530,3cyclictest25-21ksoftirqd/112:21:181
18661994520,4cyclictest25-21ksoftirqd/109:41:191
18661994519,4cyclictest25-21ksoftirqd/109:11:221
18661994518,5cyclictest25-21ksoftirqd/108:51:211
18661994518,4cyclictest25-21ksoftirqd/107:31:251
1865499459,4cyclictest9-21ksoftirqd/011:15:530
18654994530,5cyclictest9-21ksoftirqd/010:11:080
18654994520,3cyclictest9-21ksoftirqd/012:09:290
18654994519,4cyclictest9-21ksoftirqd/011:36:290
18661994419,4cyclictest25-21ksoftirqd/112:26:361
18661994419,3cyclictest25-21ksoftirqd/107:51:301
18661994418,3cyclictest25-21ksoftirqd/111:11:361
18661994417,4cyclictest25-21ksoftirqd/112:20:051
18654994419,3cyclictest9-21ksoftirqd/011:21:350
18654994328,4cyclictest9-21ksoftirqd/012:36:200
18654994319,3cyclictest9-21ksoftirqd/011:26:230
18654994317,4cyclictest9-21ksoftirqd/008:36:130
18661994219,3cyclictest25-21ksoftirqd/107:46:181
18661994217,4cyclictest25-21ksoftirqd/109:01:301
18661994216,4cyclictest25-21ksoftirqd/110:11:171
18661994215,4cyclictest25-21ksoftirqd/111:36:261
18654994228,4cyclictest9-21ksoftirqd/007:46:250
18654994218,4cyclictest9-21ksoftirqd/012:01:290
18654994215,4cyclictest9-21ksoftirqd/010:01:030
18654994215,4cyclictest9-21ksoftirqd/009:51:210
18654994215,4cyclictest9-21ksoftirqd/008:11:230
18654994214,4cyclictest9-21ksoftirqd/009:21:030
177391420,1ptp4l401ktimersoftd/307:37:153
18661994116,4cyclictest25-21ksoftirqd/110:31:051
18661994014,4cyclictest25-21ksoftirqd/108:46:111
18661994013,4cyclictest25-21ksoftirqd/110:06:031
18661994013,4cyclictest25-21ksoftirqd/110:06:031
18654993930,5cyclictest9-21ksoftirqd/010:16:200
18654993914,3cyclictest9-21ksoftirqd/009:46:210
18671993825,7cyclictest41-21ksoftirqd/308:21:143
18671993825,7cyclictest41-21ksoftirqd/308:21:143
18661993815,3cyclictest25-21ksoftirqd/107:41:011
18661993814,4cyclictest25-21ksoftirqd/110:17:361
18661993814,4cyclictest25-21ksoftirqd/107:41:161
18661993813,4cyclictest25-21ksoftirqd/107:56:261
18661993810,4cyclictest25-21ksoftirqd/110:11:041
18661993810,4cyclictest25-21ksoftirqd/110:11:041
18654993828,3cyclictest9-21ksoftirqd/010:06:130
18654993828,3cyclictest9-21ksoftirqd/010:06:130
177391380,1ptp4l401ktimersoftd/312:08:373
177391380,1ptp4l401ktimersoftd/312:02:143
177391380,1ptp4l401ktimersoftd/311:01:063
177391380,1ptp4l401ktimersoftd/310:14:423
177391380,1ptp4l401ktimersoftd/307:30:053
177391380,0ptp4l401ktimersoftd/311:48:133
177391380,0ptp4l401ktimersoftd/311:48:133
177391380,0ptp4l401ktimersoftd/311:35:103
18661993716,8cyclictest25-21ksoftirqd/109:16:191
18661993711,4cyclictest25-21ksoftirqd/108:56:191
177391370,1ptp4l401ktimersoftd/312:52:043
177391370,1ptp4l401ktimersoftd/312:46:503
177391370,1ptp4l401ktimersoftd/312:43:363
177391370,1ptp4l401ktimersoftd/312:28:083
177391370,1ptp4l401ktimersoftd/310:54:213
177391370,1ptp4l401ktimersoftd/310:21:333
177391370,1ptp4l401ktimersoftd/310:16:473
177391370,1ptp4l401ktimersoftd/307:56:103
177391370,0ptp4l401ktimersoftd/312:12:003
177391370,0ptp4l401ktimersoftd/311:38:113
1866699369,3cyclictest16525-21expr11:31:212
1866699360,3cyclictest18224-21latency_hist12:11:072
1866699360,33cyclictest11786-21diskmemload10:37:352
18661993630,4cyclictest25-21ksoftirqd/107:26:001
177391360,1ptp4l401ktimersoftd/311:24:473
177391360,0ptp4l401ktimersoftd/311:20:273
177391360,0ptp4l401ktimersoftd/311:09:073
177391360,0ptp4l401ktimersoftd/309:33:553
1867199355,18cyclictest24695-21ssh11:41:213
1867199351,5cyclictest13776-21ssh10:06:293
1867199351,5cyclictest13776-21ssh10:06:293
1866699359,3cyclictest5178-21expr12:31:212
1866699357,6cyclictest1595-21unixbench-2d09:01:322
18666993520,12cyclictest33-21ksoftirqd/208:23:022
18666993520,12cyclictest33-21ksoftirqd/208:23:022
18666993511,3cyclictest31755-21seq11:10:092
18661993512,4cyclictest25-21ksoftirqd/108:41:181
177391350,2ptp4l23922-21kworker/3:110:39:503
177391350,0ptp4l401ktimersoftd/310:48:473
177391350,0ptp4l401ktimersoftd/309:42:203
177391350,0ptp4l401ktimersoftd/309:21:203
1866699349,4cyclictest11077-21expr08:16:172
1866699348,4cyclictest6418-21fschecks_count08:06:172
1866699342,4cyclictest0-21swapper/212:36:202
1866699341,4cyclictest10733-21sed09:21:232
18666993412,3cyclictest20909-21expr10:56:192
1866699341,12cyclictest1850-21snmp_o5powerctl10:31:302
1866699332,6cyclictest28906-21apt-get10:26:172
18666993318,12cyclictest33-21ksoftirqd/210:16:072
1866699331,5cyclictest27839-21grep08:51:182
1866699331,11cyclictest24693-21apt-get11:41:222
18666993310,3cyclictest21467-21sh07:31:032
18666993310,3cyclictest20454-21cpuspeed_turbos08:36:152
177391330,2ptp4l23922-21kworker/3:109:11:273
177391330,1ptp4l401ktimersoftd/310:41:223
177391330,0ptp4l401ktimersoftd/312:35:053
18671993226,3cyclictest41-21ksoftirqd/308:51:153
1866699329,3cyclictest12616-21grep09:26:212
1866699328,4cyclictest25444-21fschecks_time08:46:182
1866699321,28cyclictest14064-21snmp_o5powerctl10:06:332
1866699321,28cyclictest14064-21snmp_o5powerctl10:06:332
18666993211,4cyclictest11053-21sh11:24:282
1866699321,12cyclictest2748-21ssh11:52:152
1866699321,12cyclictest2748-21ssh11:52:152
18666993210,4cyclictest3923-21/usr/sbin/munin11:16:222
1866699320,10cyclictest19291-21mailstats08:31:262
177391320,1ptp4l401ktimersoftd/309:58:553
177391320,1ptp4l401ktimersoftd/308:11:273
1866699318,3cyclictest41342chrt09:07:022
1866699318,3cyclictest23633-21fschecks_count12:16:252
1866699317,3cyclictest9351-21latency_hist09:21:032
1866699312,7cyclictest24751-21apt-get09:41:152
1866699312,6cyclictest18101-21snmp_o5powerctl10:51:312
1866699312,5cyclictest4761-21apt-get09:11:162
1866699311,4cyclictest0-21swapper/210:11:172
1866699310,4cyclictest29139-21sort11:46:232
1866699310,4cyclictest29139-21sort11:46:232
1866699310,11cyclictest20595-21tr11:36:202
177391310,1ptp4l401ktimersoftd/308:43:303
177391310,1ptp4l401ktimersoftd/308:18:543
177391310,0ptp4l401ktimersoftd/308:35:393
18671993024,3cyclictest41-21ksoftirqd/307:56:003
1866699309,3cyclictest16509-21latency_hist10:51:052
1866699308,3cyclictest9115-21basename10:01:212
1866699308,3cyclictest9115-21basename10:01:212
1866699308,3cyclictest233932chrt09:38:332
1866699307,4cyclictest22708-21bc08:41:162
1866699307,3cyclictest15348-21sed12:41:282
1866699306,3cyclictest0-21swapper/212:51:292
1866699302,5cyclictest27969-21apt-get12:21:152
18666993011,3cyclictest9815-21fschecks_time12:01:212
18666993011,3cyclictest2524-21sh12:27:222
1866699301,10cyclictest28733-21tr09:46:172
177391300,1ptp4l401ktimersoftd/308:30:233
177391300,0ptp4l401ktimersoftd/308:03:473
1867199294,15cyclictest1028-21snmpd08:06:133
18671992923,3cyclictest41-21ksoftirqd/308:46:143
1866699299,3cyclictest29358-21fschecks_count07:46:182
1866699299,3cyclictest20224-21sh09:35:482
1866699298,3cyclictest19208-21cut07:26:152
1866699297,5cyclictest11786-21diskmemload09:58:202
1866699294,8cyclictest0-21swapper/210:41:492
18666992910,3cyclictest0-21swapper/207:51:162
1866699290,4cyclictest3565-21ssh09:55:032
18671992821,4cyclictest41-21ksoftirqd/310:31:043
1866699288,3cyclictest8810-21sh12:00:382
1866699288,3cyclictest26857-21sh11:02:322
1866699288,3cyclictest21395-21ssh12:13:212
18666992810,3cyclictest26177-21rt-features10:21:282
177391280,1ptp4l401ktimersoftd/309:37:113
177391280,1ptp4l401ktimersoftd/309:20:133
18671992722,3cyclictest41-21ksoftirqd/307:31:033
1866699279,3cyclictest1760-21runrttasks08:27:132
1866699269,3cyclictest28950-21latency_hist07:46:002
18666992620,3cyclictest33-21ksoftirqd/207:39:282
1866699260,14cyclictest0-21swapper/212:46:342
177391260,1ptp4l401ktimersoftd/307:48:303
18671992519,3cyclictest41-21ksoftirqd/309:01:463
18666992519,3cyclictest33-21ksoftirqd/208:14:532
177391250,1ptp4l401ktimersoftd/312:36:253
18671992418,3cyclictest41-21ksoftirqd/311:51:233
18671992418,3cyclictest41-21ksoftirqd/311:51:233
1866699248,3cyclictest12718-21if_enp1s011:26:232
18666992418,4cyclictest33-21ksoftirqd/208:59:392
177391240,1ptp4l401ktimersoftd/311:56:343
18666992316,4cyclictest33-21ksoftirqd/208:04:392
177391230,1ptp4l401ktimersoftd/308:36:243
18666992014,3cyclictest2972-21unixbench-2d07:56:312
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional