You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-10-15 - 09:34
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot6.osadl.org (updated Wed Oct 15, 2025 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
502721840,5sleep1204199cyclictest20:01:141
1377121610,5sleep1204199cyclictest00:46:381
1773911000,36ptp4l401ktimersoftd/319:51:413
182662810,5sleep0203699cyclictest22:26:130
182662810,5sleep0203699cyclictest22:26:130
2050997768,5cyclictest33-21ksoftirqd/223:56:282
177391720,1ptp4l401ktimersoftd/320:13:113
99482660,5sleep2205099cyclictest00:06:282
99482660,5sleep2205099cyclictest00:06:282
267972650,3sleep20-21swapper/223:47:052
132772650,3sleep10-21swapper/101:22:591
15792614,10sleep20-21swapper/219:51:462
177391590,1ptp4l401ktimersoftd/323:57:173
26712570,1sleep30-21swapper/323:21:293
177391570,1ptp4l401ktimersoftd/320:23:553
277362560,2sleep30-21swapper/321:59:593
204199569,17cyclictest22934-21awk21:51:351
27312550,2sleep30-21swapper/300:34:443
2050995543,6cyclictest33-21ksoftirqd/221:21:222
68242500,1sleep30-21swapper/300:39:093
2050995038,6cyclictest33-21ksoftirqd/223:11:262
2050995036,8cyclictest33-21ksoftirqd/200:36:322
204199506,17cyclictest9931-21latency_hist20:11:101
177391500,1ptp4l401ktimersoftd/300:30:053
177391460,1ptp4l401ktimersoftd/300:13:113
204199454,13cyclictest30018-21ssh23:15:441
177391450,0ptp4l401ktimersoftd/322:20:153
295812430,1sleep30-21swapper/322:01:313
2050994231,9cyclictest33-21ksoftirqd/200:06:162
2050994034,3cyclictest33-21ksoftirqd/222:41:132
2050994024,7cyclictest33-21ksoftirqd/221:01:112
177391400,1ptp4l401ktimersoftd/322:28:083
177391400,1ptp4l401ktimersoftd/322:28:083
177391400,1ptp4l401ktimersoftd/301:00:493
2050993934,3cyclictest33-21ksoftirqd/201:26:182
204199394,12cyclictest0-21swapper/123:33:271
177391390,1ptp4l401ktimersoftd/301:06:123
177391390,1ptp4l401ktimersoftd/300:41:193
177391390,1ptp4l401ktimersoftd/300:17:023
177391380,1ptp4l401ktimersoftd/323:48:283
177391380,1ptp4l401ktimersoftd/323:32:213
177391380,1ptp4l401ktimersoftd/322:53:523
177391380,1ptp4l401ktimersoftd/322:39:153
177391380,1ptp4l401ktimersoftd/322:10:273
177391380,1ptp4l401ktimersoftd/321:46:113
177391380,1ptp4l401ktimersoftd/301:25:343
177391380,1ptp4l401ktimersoftd/301:08:243
177391380,1ptp4l401ktimersoftd/300:23:223
177391380,11ptp4l401ktimersoftd/323:14:113
307592370,4sleep2205099cyclictest23:16:302
2050993732,3cyclictest33-21ksoftirqd/222:26:132
2050993732,3cyclictest33-21ksoftirqd/222:26:132
204199378,17cyclictest25735-21snmp_o5powerctl21:56:391
177391370,1ptp4l401ktimersoftd/323:51:383
177391370,1ptp4l401ktimersoftd/323:20:563
177391370,1ptp4l401ktimersoftd/323:07:183
177391370,1ptp4l401ktimersoftd/320:46:293
177391370,1ptp4l401ktimersoftd/300:11:063
177391370,1ptp4l401ktimersoftd/300:11:063
177391370,0ptp4l401ktimersoftd/323:28:543
76712360,18sleep125-21ksoftirqd/123:26:321
2050993631,3cyclictest33-21ksoftirqd/220:46:232
177391360,1ptp4l401ktimersoftd/323:41:303
177391360,1ptp4l401ktimersoftd/323:36:243
177391360,1ptp4l401ktimersoftd/322:47:403
177391360,1ptp4l401ktimersoftd/322:31:283
177391360,1ptp4l401ktimersoftd/301:19:293
177391360,0ptp4l401ktimersoftd/300:04:053
2050993530,3cyclictest33-21ksoftirqd/223:01:152
2050993529,3cyclictest33-21ksoftirqd/220:01:112
2050993529,3cyclictest24586-21latency_hist23:46:152
2050993528,4cyclictest33-21ksoftirqd/221:36:122
204199356,16cyclictest0-21swapper/100:33:191
204199352,11cyclictest0-21swapper/123:25:271
204199352,11cyclictest0-21swapper/120:51:301
177391350,1ptp4l401ktimersoftd/320:06:413
177391350,1ptp4l401ktimersoftd/301:12:143
2050993429,3cyclictest33-21ksoftirqd/222:06:122
2050993429,3cyclictest33-21ksoftirqd/221:01:262
2050993429,3cyclictest33-21ksoftirqd/220:41:112
2050993429,3cyclictest33-21ksoftirqd/220:41:112
2050993429,3cyclictest33-21ksoftirqd/200:16:152
204199343,8cyclictest28226-21snmp_o5powerctl20:46:341
177391340,2ptp4l7077-21kworker/3:023:02:553
177391340,2ptp4l4428-21kworker/3:121:26:243
177391340,2ptp4l4428-21kworker/3:120:46:033
177391340,2ptp4l4428-21kworker/3:120:46:033
2050993328,3cyclictest33-21ksoftirqd/223:31:302
2050993327,3cyclictest33-21ksoftirqd/221:41:302
2050993327,3cyclictest33-21ksoftirqd/200:26:162
204199338,9cyclictest7308-21hddtemp_smartct01:16:361
204199337,8cyclictest28821-21snmp_o5powerctl22:36:431
204199335,16cyclictest0-21swapper/122:27:211
204199335,16cyclictest0-21swapper/122:27:211
2041993320,6cyclictest31777-21apt-get22:41:261
2041993318,9cyclictest19463-21apt-get21:46:251
177391330,2ptp4l4428-21kworker/3:120:39:003
177391330,2ptp4l4428-21kworker/3:120:39:003
177391330,1ptp4l401ktimersoftd/322:56:163
177391330,1ptp4l401ktimersoftd/322:44:423
177391330,1ptp4l401ktimersoftd/322:23:403
177391330,1ptp4l401ktimersoftd/322:23:403
177391330,1ptp4l401ktimersoftd/322:13:083
177391330,1ptp4l401ktimersoftd/321:37:353
177391330,1ptp4l401ktimersoftd/321:06:333
2050993227,3cyclictest33-21ksoftirqd/222:51:272
2050993227,3cyclictest33-21ksoftirqd/221:51:322
2050993226,3cyclictest33-21ksoftirqd/223:51:472
2050993226,3cyclictest33-21ksoftirqd/222:51:142
2050993226,3cyclictest33-21ksoftirqd/221:46:272
2050993220,10cyclictest33-21ksoftirqd/200:46:382
204199326,14cyclictest31938-21ssh22:04:331
204199325,14cyclictest9443-21ssh00:41:381
204199322,18cyclictest0-21swapper/101:11:311
177391320,1ptp4l401ktimersoftd/321:52:463
177391320,1ptp4l401ktimersoftd/321:04:433
177391320,0ptp4l401ktimersoftd/320:33:003
177391320,0ptp4l401ktimersoftd/300:55:263
177391320,0ptp4l401ktimersoftd/300:46:523
17422325,17sleep09-21ksoftirqd/019:53:500
7872316,11sleep10-21swapper/119:51:331
2050993126,3cyclictest33-21ksoftirqd/223:06:332
2050993126,3cyclictest33-21ksoftirqd/222:41:262
2050993126,3cyclictest33-21ksoftirqd/222:21:132
2050993126,3cyclictest33-21ksoftirqd/201:01:372
2050993126,3cyclictest33-21ksoftirqd/200:31:162
2050993123,4cyclictest33-21ksoftirqd/220:16:242
2050993118,10cyclictest33-21ksoftirqd/223:26:322
204199316,5cyclictest0-21swapper/100:21:431
204199314,14cyclictest23297-21ssh23:43:581
2041993118,6cyclictest27581-21apt-get00:26:321
2041993110,17cyclictest2674-21tune2fs19:56:261
177391310,1ptp4l401ktimersoftd/320:58:503
177391310,1ptp4l401ktimersoftd/320:02:273
2050993025,3cyclictest33-21ksoftirqd/220:11:302
2050993025,3cyclictest33-21ksoftirqd/219:56:292
2050993025,3cyclictest33-21ksoftirqd/201:11:392
2050993024,3cyclictest33-21ksoftirqd/223:36:312
2050993019,9cyclictest33-21ksoftirqd/221:06:282
2050993018,10cyclictest33-21ksoftirqd/221:36:362
204199306,9cyclictest6933-21snmp_o5powerctl00:01:401
204199303,12cyclictest0-21swapper/120:11:341
204199302,17cyclictest0-21swapper/120:21:291
204199302,12cyclictest0-21swapper/120:41:301
204199302,12cyclictest0-21swapper/120:41:301
2041993018,7cyclictest18921-21apt-get21:43:541
2041993017,8cyclictest16010-21apt-get23:36:291
2036993025,3cyclictest9-21ksoftirqd/000:16:160
2036993024,3cyclictest9-21ksoftirqd/022:36:370
177391300,0ptp4l401ktimersoftd/321:17:033
177391300,0ptp4l401ktimersoftd/320:53:343
177391300,0ptp4l401ktimersoftd/320:17:233
2050992924,3cyclictest33-21ksoftirqd/222:56:362
2050992924,3cyclictest33-21ksoftirqd/222:31:132
2050992924,3cyclictest33-21ksoftirqd/222:31:132
2050992924,3cyclictest33-21ksoftirqd/222:11:312
2050992924,3cyclictest33-21ksoftirqd/221:26:292
2050992924,3cyclictest33-21ksoftirqd/220:51:312
2050992924,3cyclictest33-21ksoftirqd/201:06:372
2050992924,3cyclictest33-21ksoftirqd/200:51:362
2050992924,3cyclictest33-21ksoftirqd/200:31:392
2050992923,3cyclictest33-21ksoftirqd/220:26:102
2050992923,3cyclictest33-21ksoftirqd/200:56:392
2050992923,3cyclictest33-21ksoftirqd/200:41:462
2050992922,4cyclictest33-21ksoftirqd/223:21:362
204199296,8cyclictest14083-21ssh22:21:271
204199296,8cyclictest14083-21ssh22:21:271
204199296,7cyclictest32223-21ssh23:16:451
204199295,14cyclictest23892-21diskmemload23:51:571
204199294,9cyclictest7872-21munin-run00:41:161
2041992917,6cyclictest14289-21apt-get00:11:281
2041992916,8cyclictest17006-21apt-get00:51:301
204199290,11cyclictest0-21swapper/122:16:411
2036992924,3cyclictest9-21ksoftirqd/000:26:360
2036992923,3cyclictest9-21ksoftirqd/021:33:240
2036992921,4cyclictest7124-21fschecks_count01:16:340
2050992823,3cyclictest33-21ksoftirqd/220:06:302
2050992823,3cyclictest33-21ksoftirqd/201:16:422
2050992822,3cyclictest33-21ksoftirqd/200:16:332
204199285,8cyclictest3024-21ssh23:56:531
204199285,8cyclictest21101-21ssh23:05:441
2041992821,4cyclictest25-21ksoftirqd/120:40:401
2041992821,4cyclictest25-21ksoftirqd/120:40:401
2041992817,6cyclictest8470-21apt-get22:51:251
2041992817,5cyclictest5190-21apt-get22:11:241
2041992810,14cyclictest30436-21cpuspeed_turbos01:06:321
2036992823,3cyclictest9-21ksoftirqd/023:46:450
2036992823,3cyclictest9-21ksoftirqd/022:31:340
2036992821,4cyclictest9-21ksoftirqd/020:01:450
2050992722,3cyclictest33-21ksoftirqd/221:11:312
204199276,9cyclictest18538-21snmp_o5powerctl20:26:391
204199275,8cyclictest23892-21diskmemload00:58:421
2036992721,3cyclictest9-21ksoftirqd/023:04:390
2036992721,3cyclictest9-21ksoftirqd/021:58:310
2036992720,4cyclictest9-21ksoftirqd/021:19:450
203699271,16cyclictest64-21kswapd023:36:290
177391270,1ptp4l401ktimersoftd/319:58:383
2050992621,3cyclictest33-21ksoftirqd/222:06:312
2050992621,3cyclictest33-21ksoftirqd/222:01:132
2050992621,3cyclictest33-21ksoftirqd/220:31:292
2050992620,4cyclictest33-21ksoftirqd/220:26:442
2050992619,3cyclictest33-21ksoftirqd/220:46:112
2050992619,3cyclictest33-21ksoftirqd/220:46:112
204199263,8cyclictest16115-21ssh22:59:371
204199262,11cyclictest0-21swapper/122:06:411
2041992615,7cyclictest13784-21snmp_o5powerctl20:16:371
2036992621,3cyclictest9-21ksoftirqd/000:06:390
2036992621,3cyclictest9-21ksoftirqd/000:06:390
2036992620,3cyclictest9-21ksoftirqd/023:33:520
2036992620,3cyclictest9-21ksoftirqd/023:21:290
2036992619,4cyclictest9-21ksoftirqd/020:55:360
177391260,0ptp4l401ktimersoftd/321:48:393
2058992518,4cyclictest41-21ksoftirqd/321:31:483
204199256,5cyclictest0-21swapper/101:06:071
204199254,6cyclictest0-21swapper/122:46:371
204199254,6cyclictest0-21swapper/122:32:061
204199254,6cyclictest0-21swapper/100:16:411
2041992520,3cyclictest25-21ksoftirqd/121:28:131
2041992519,4cyclictest25-21ksoftirqd/100:06:271
2041992519,4cyclictest25-21ksoftirqd/100:06:271
2041992519,3cyclictest25-21ksoftirqd/120:56:301
2041992513,8cyclictest5314-21snmp_o5powerctl21:06:371
2041992512,8cyclictest24822-21apt-get23:46:281
2041992511,11cyclictest23527-21grep23:06:431
2036992520,3cyclictest9-21ksoftirqd/023:06:280
2036992520,3cyclictest9-21ksoftirqd/000:41:160
2036992520,3cyclictest11586-1kworker/u9:122:20:530
2036992519,4cyclictest9-21ksoftirqd/022:50:020
2036992519,4cyclictest9-21ksoftirqd/021:55:500
2036992519,3cyclictest9-21ksoftirqd/020:20:100
2036992519,3cyclictest9-21ksoftirqd/020:13:330
2036992518,4cyclictest9-21ksoftirqd/021:03:270
2036992518,4cyclictest9-21ksoftirqd/020:44:360
2036992518,4cyclictest9-21ksoftirqd/020:44:360
2036992518,4cyclictest8161-21cut20:06:270
177391250,1ptp4l401ktimersoftd/320:26:253
2050992419,3cyclictest33-21ksoftirqd/222:31:272
2041992418,3cyclictest25-21ksoftirqd/121:31:341
2041992418,3cyclictest25-21ksoftirqd/121:16:111
2041992412,9cyclictest11392-21awk21:26:121
2036992420,3cyclictest9-21ksoftirqd/020:25:570
2036992420,3cyclictest9-21ksoftirqd/000:16:410
2036992419,3cyclictest9-21ksoftirqd/000:53:130
2036992419,3cyclictest9-21ksoftirqd/000:26:160
2036992418,4cyclictest9-21ksoftirqd/022:55:280
2036992418,3cyclictest9-21ksoftirqd/023:15:460
2036992418,3cyclictest9-21ksoftirqd/021:45:240
2036992418,3cyclictest9-21ksoftirqd/020:56:430
2036992418,3cyclictest9-21ksoftirqd/000:35:000
2036992417,4cyclictest9-21ksoftirqd/020:48:420
177391240,1ptp4l401ktimersoftd/321:21:223
177391240,1ptp4l401ktimersoftd/321:11:363
2041992318,3cyclictest25-21ksoftirqd/121:38:401
2041992312,8cyclictest21245-21taskset20:31:401
2041992311,9cyclictest9009-21idleruntime-cro21:21:121
2041992310,10cyclictest2565-21wc21:01:331
2036992317,3cyclictest9-21ksoftirqd/021:10:340
2036992316,4cyclictest5689-21ssh00:01:300
2050992217,3cyclictest33-21ksoftirqd/221:21:122
2036992218,3cyclictest9-21ksoftirqd/022:41:300
2036992218,3cyclictest9-21ksoftirqd/019:56:260
2036992217,3cyclictest9-21ksoftirqd/020:34:060
2036992216,3cyclictest9-21ksoftirqd/022:11:250
2036992216,3cyclictest9-21ksoftirqd/021:48:100
2036992215,4cyclictest14473-21grep00:46:470
203699212,16cyclictest25986-21grep01:01:320
2036992115,3cyclictest9-21ksoftirqd/022:28:140
2036992115,3cyclictest9-21ksoftirqd/022:28:140
2036992115,3cyclictest9-21ksoftirqd/022:06:170
2036992115,3cyclictest9-21ksoftirqd/021:39:500
2036992115,3cyclictest9-21ksoftirqd/001:14:550
2036992114,4cyclictest11622-21/usr/sbin/munin21:26:300
203699203,8cyclictest7145-21ssh23:26:270
2036992015,3cyclictest9-21ksoftirqd/023:41:410
2036992015,3cyclictest9-21ksoftirqd/000:41:320
2036992014,3cyclictest9-21ksoftirqd/021:11:220
2036992014,3cyclictest17443-21df20:26:270
2036992014,3cyclictest14045-21nfs4_client22:56:380
2036992014,3cyclictest10908-21/usr/sbin/munin01:21:320
2036992013,4cyclictest10375-21head21:21:310
2036992011,5cyclictest32072-21grep01:06:480
2036991914,3cyclictest9-21ksoftirqd/022:04:410
2036991913,3cyclictest9-21ksoftirqd/023:16:350
2036991912,4cyclictest21537-21cpu00:56:310
2036991812,3cyclictest30113-21cut23:51:380
2036991812,3cyclictest22180-21sh20:36:250
2036991812,3cyclictest22180-21sh20:36:250
2036991812,3cyclictest1829-21irqrtprio23:56:350
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional