You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-19 - 06:47
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot6.osadl.org (updated Sat Jul 19, 2025 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2421221600,4sleep0996199cyclictest02:10:120
2653821390,3sleep0996199cyclictest03:23:270
1518911220,8ptp4l22060-21kworker/3:122:08:313
1518911220,8ptp4l22060-21kworker/3:122:08:313
88772933,22sleep08940-21/usr/sbin/munin22:04:240
88772933,22sleep08940-21/usr/sbin/munin22:04:240
185922630,4sleep018593-21cat00:59:050
311032610,2sleep30-21swapper/301:10:573
113182590,4sleep311323-21irqrtprio01:24:223
9982995441,7cyclictest41-21ksoftirqd/303:29:223
86352540,2sleep10-21swapper/123:09:301
150742540,2sleep30-21swapper/302:34:363
65732520,2sleep10-21swapper/100:45:011
114002520,2sleep20-21swapper/200:16:402
972124626,8sleep20-21swapper/222:07:162
972124626,8sleep20-21swapper/222:07:162
996199424,9cyclictest30069-21apt-get22:49:140
9961994215,24cyclictest10160-21grep23:14:200
9965994016,21cyclictest22489-21grep02:09:201
998299392,31cyclictest0-21swapper/323:39:163
996599393,8cyclictest16632-21apt-get23:29:151
9965993919,17cyclictest25-21ksoftirqd/122:26:141
9965993912,5cyclictest25505-21grep01:39:241
996199393,9cyclictest1009-21apt-get00:04:150
996199393,10cyclictest31079-21apt-get23:59:170
9961993914,4cyclictest1694-21sh03:30:500
9961993914,3cyclictest26135-21sed23:49:030
9961993913,3cyclictest6080-21tune2fs01:19:230
955323920,9sleep10-21swapper/122:05:051
955323920,9sleep10-21swapper/122:05:051
151891390,1ptp4l401ktimersoftd/302:24:353
9965993812,4cyclictest19907-21ls00:59:261
996199382,7cyclictest23692-21apt-get01:04:170
996199381,7cyclictest12232-21apt-get01:59:180
9961993814,4cyclictest25350-21sh01:39:220
9961993813,3cyclictest4202-21expr02:24:210
9961993813,3cyclictest28530-21bc01:09:210
9961993813,3cyclictest22817-21sh01:35:540
9961993813,3cyclictest22817-21sh01:35:540
9961993813,3cyclictest19307-21sh01:33:340
9961993813,3cyclictest19307-21sh01:33:340
9961993813,3cyclictest14793-21sh01:28:590
9961993812,4cyclictest5778-21sh01:52:170
9961993812,4cyclictest17973-21irqrtprio02:04:260
9961993812,3cyclictest23942-21ptp4l00:29:260
9961993810,4cyclictest5116-21grep23:04:200
151891380,1ptp4l401ktimersoftd/323:29:283
151891380,1ptp4l401ktimersoftd/302:19:023
151891380,1ptp4l401ktimersoftd/301:37:493
151891380,1ptp4l401ktimersoftd/301:37:493
996599373,7cyclictest32741-21apt-get02:54:211
9965993714,3cyclictest8843-21sh02:29:211
9965993712,4cyclictest9945-21sh03:04:271
9965993712,4cyclictest3420-21latency_hist03:34:081
9965993712,4cyclictest31606-21cat22:49:311
9965993712,4cyclictest21141-21sh00:27:031
996199373,7cyclictest18009-21apt-get22:24:140
9961993713,4cyclictest12792-21df_inode22:14:030
9961993713,3cyclictest27193-21/usr/sbin/munin03:24:280
9961993713,3cyclictest27193-21/usr/sbin/munin03:24:280
9961993712,3cyclictest7205-21cpuspeed_turbos23:09:150
9961993710,4cyclictest19193-21ls23:34:200
151891370,1ptp4l401ktimersoftd/302:54:213
151891370,1ptp4l401ktimersoftd/302:21:063
151891370,1ptp4l401ktimersoftd/301:48:563
151891370,1ptp4l401ktimersoftd/301:48:563
151891370,1ptp4l401ktimersoftd/300:49:273
151891370,1ptp4l401ktimersoftd/300:29:263
998299369,24cyclictest19209-21expr23:34:203
998299369,24cyclictest14013-21sed00:19:243
998299361,29cyclictest0-21swapper/302:39:203
998299360,5cyclictest10755-21rt-features23:14:243
998299360,3cyclictest18514-21/usr/sbin/munin03:14:213
996599362,10cyclictest32109-21apt-get00:39:151
9965993613,4cyclictest10232-21seq00:14:371
9965993613,3cyclictest21054-21sh03:16:161
9965993612,3cyclictest6279-21sh03:36:061
9965993612,3cyclictest16642-21sh01:29:311
9965993612,3cyclictest16642-21sh01:29:311
9965993612,3cyclictest11761-21ls01:59:061
996199369,4cyclictest28605-21phc2sys-jitter00:34:280
996199368,5cyclictest19871-21latency00:59:260
996199364,8cyclictest23143-21apt-get02:44:190
996199364,7cyclictest14158-21apt-get03:09:220
996199363,8cyclictest2400-21apt-get22:59:150
9961993612,3cyclictest17186-21seq02:37:460
9961993612,3cyclictest1505-21runrttasks22:34:040
151891360,1ptp4l401ktimersoftd/323:46:593
151891360,1ptp4l401ktimersoftd/322:59:373
151891360,1ptp4l401ktimersoftd/322:36:213
151891360,1ptp4l401ktimersoftd/301:40:093
151891360,0ptp4l401ktimersoftd/300:14:173
998299359,23cyclictest30976-21latency22:49:223
998299350,4cyclictest3913-21grep00:09:213
998299350,4cyclictest23943-21seq02:09:443
998299350,4cyclictest2009-21awk01:14:263
998299350,3cyclictest29706-21rm03:25:533
998299350,3cyclictest29706-21rm03:25:533
998299350,3cyclictest0-21swapper/300:34:263
996599353,6cyclictest3081-21diskmemload00:49:181
996599352,8cyclictest20373-21apt-get22:29:141
9965993513,3cyclictest21523-21cat23:39:151
9965993512,4cyclictest25481-21sh02:45:281
9965993512,4cyclictest23138-21sh01:36:291
9965993512,4cyclictest23138-21sh01:36:291
9965993512,3cyclictest14629-21ls02:34:281
9965993511,3cyclictest7637-21sh02:27:491
996199359,4cyclictest22751-21latency_hist02:44:080
996199359,3cyclictest12800-21seq03:07:090
996199353,11cyclictest22700-21phc2sys23:39:250
9961993513,3cyclictest6610-21sh00:45:050
9961993510,4cyclictest3430-21/usr/sbin/munin00:09:330
9961993510,3cyclictest32027-21/usr/sbin/munin00:39:240
9961993510,3cyclictest18837-21fschecks_time03:14:240
151891350,1ptp4l401ktimersoftd/301:23:483
151891350,0ptp4l401ktimersoftd/303:19:353
998299343,24cyclictest15289-21apt-get01:29:213
998299343,24cyclictest15289-21apt-get01:29:213
998299341,5cyclictest5022-21hddtemp_smartct00:44:243
9982993413,18cyclictest6544-21sh03:36:393
9982993412,19cyclictest18876-21unixbench_singl02:04:373
9982993412,18cyclictest15813-21cat22:19:193
998299340,4cyclictest8475-21snmp_o5powerctl23:09:283
998299340,4cyclictest27222-21taskset22:41:553
998299340,4cyclictest15827-21ssh02:02:403
998299340,3cyclictest12059-21cstates23:19:163
998299340,2cyclictest294292chrt22:44:513
996599347,4cyclictest0-21swapper/101:19:231
996599346,7cyclictest10162-21irqrtprio23:14:201
9965993413,3cyclictest5304-21sh01:51:261
9965993412,3cyclictest3004-21sshd00:08:101
9965993412,3cyclictest10871-21irqrtprio22:09:201
9965993411,3cyclictest20889-21sh02:08:091
996199349,5cyclictest47350irq/99-ens3-TxR02:14:200
9961993411,4cyclictest47350irq/99-ens3-TxR00:24:040
9961993411,3cyclictest1505-21runrttasks23:56:460
9961993411,3cyclictest1505-21runrttasks23:56:460
9961993410,3cyclictest2167-21vmstat02:54:390
996199340,5cyclictest9846-21sed02:29:280
998299339,21cyclictest700-21idleruntime-cro00:04:033
998299338,22cyclictest1002-21sed00:39:253
9982993314,16cyclictest13179-21/usr/sbin/munin22:14:163
9982993312,18cyclictest17818-21sh00:57:563
9982993312,17cyclictest28616-21/usr/sbin/munin23:54:193
9982993312,17cyclictest28616-21/usr/sbin/munin23:54:193
9982993310,20cyclictest32322-21latency_hist02:54:073
998299330,4cyclictest7647-21ssh03:00:493
998299330,4cyclictest12013-21ssh03:05:453
998299330,3cyclictest17770-21ssh00:24:053
998299330,3cyclictest10447-21ssh01:57:033
9974993326,4cyclictest33-21ksoftirqd/222:14:012
996599332,8cyclictest23692-21apt-get01:04:161
9965993311,3cyclictest32441-21wc22:54:141
996599330,8cyclictest296412rm02:16:201
996199339,3cyclictest7337-21sh03:00:170
996199339,3cyclictest18563-21cat00:24:210
998299328,21cyclictest14856-21irqrtprio03:09:293
998299328,20cyclictest24745-21cat01:04:253
998299326,22cyclictest26774-21gltestperf23:49:243
998299320,4cyclictest21550-21ssh01:01:023
9965993213,3cyclictest29741-21phc2sys-jitter01:09:311
9965993210,4cyclictest30690-21sh01:44:251
9965993210,4cyclictest30690-21sh01:44:251
9965993210,4cyclictest15740-21sh02:02:311
9965993210,3cyclictest24807-21irqrtprio23:44:231
998299318,20cyclictest20599-21expr22:29:153
998299318,20cyclictest10141-21which02:29:303
9974993125,3cyclictest33-21ksoftirqd/201:09:222
996599318,5cyclictest2289-21sh02:21:491
996599312,6cyclictest15649-21apt-get22:19:171
9965993111,3cyclictest28863-21timerandwakeup03:24:391
9965993111,3cyclictest28863-21timerandwakeup03:24:391
998299305,21cyclictest53582chrt23:04:223
998299301,4cyclictest2412-21apt-get01:49:183
998299300,3cyclictest23408-21df02:44:203
998299300,3cyclictest14528-21diskstats23:24:203
9965993011,4cyclictest3081-21diskmemload02:52:281
996199303,6cyclictest9276-21apt-get00:49:180
996199301,5cyclictest7859-21if_ens301:54:270
998299295,4cyclictest1051-21needreboot22:54:223
998299294,4cyclictest18314-21fschecks_count22:24:183
998299290,3cyclictest11556-21snmp_o5powerctl22:09:263
997499297,13cyclictest4513-21ssh00:44:192
9974992923,3cyclictest33-21ksoftirqd/222:14:012
996199294,4cyclictest0-21swapper/022:29:150
145822922,3sleep233-21ksoftirqd/222:54:312
998299281,5cyclictest2088-21head00:04:243
9974992823,3cyclictest33-21ksoftirqd/201:09:042
9974992822,4cyclictest33-21ksoftirqd/202:55:592
9974992822,3cyclictest33-21ksoftirqd/202:04:202
9974992821,4cyclictest33-21ksoftirqd/223:12:282
9974992821,4cyclictest33-21ksoftirqd/203:31:522
9974992821,4cyclictest33-21ksoftirqd/200:33:382
9974992821,4cyclictest33-21ksoftirqd/200:10:132
9965992822,3cyclictest25-21ksoftirqd/122:14:261
9974992722,3cyclictest33-21ksoftirqd/202:44:372
9974992721,4cyclictest33-21ksoftirqd/202:34:212
9974992721,3cyclictest33-21ksoftirqd/222:41:562
9974992720,4cyclictest33-21ksoftirqd/223:33:002
9974992720,4cyclictest33-21ksoftirqd/223:20:512
9974992720,4cyclictest33-21ksoftirqd/223:05:382
9974992719,5cyclictest33-21ksoftirqd/202:59:282
997499271,23cyclictest2523-21grep01:49:182
997499271,19cyclictest3081-21diskmemload01:26:252
9961992720,4cyclictest9-21ksoftirqd/023:52:570
9961992720,4cyclictest9-21ksoftirqd/022:23:200
9974992620,4cyclictest33-21ksoftirqd/202:24:262
9974992620,3cyclictest33-21ksoftirqd/200:37:432
9974992619,4cyclictest33-21ksoftirqd/223:55:082
9974992619,4cyclictest33-21ksoftirqd/223:55:082
9974992619,4cyclictest33-21ksoftirqd/223:49:222
9974992619,4cyclictest33-21ksoftirqd/223:02:002
9974992619,4cyclictest33-21ksoftirqd/222:20:572
9974992619,4cyclictest33-21ksoftirqd/201:57:012
9965992620,3cyclictest25-21ksoftirqd/100:02:291
9965992619,4cyclictest25-21ksoftirqd/123:08:541
9961992619,4cyclictest9-21ksoftirqd/023:33:220
9961992619,4cyclictest9-21ksoftirqd/002:22:080
9961992619,4cyclictest26677-21snmp_o5powerctl22:39:280
9974992520,3cyclictest33-21ksoftirqd/203:34:322
9974992519,3cyclictest33-21ksoftirqd/223:29:022
9974992519,3cyclictest33-21ksoftirqd/222:49:132
9974992519,3cyclictest33-21ksoftirqd/203:14:072
9974992518,4cyclictest12238-21ssh03:06:142
997499251,5cyclictest21700-21sensors_temp22:29:252
997499251,21cyclictest7581-21ssh01:19:412
997499251,21cyclictest15510-21snmp_o5powerctl00:54:302
9974992512,10cyclictest19291-21perl00:59:222
997499251,20cyclictest11601-21apt-get01:59:082
996599258,4cyclictest185952rm00:59:051
9965992519,3cyclictest25-21ksoftirqd/123:51:371
9965992519,3cyclictest25-21ksoftirqd/122:39:271
9965992519,3cyclictest25-21ksoftirqd/101:14:201
9965992519,3cyclictest25-21ksoftirqd/100:29:291
9965992519,3cyclictest23268-21tune2fs03:19:251
9974992418,3cyclictest33-21ksoftirqd/222:34:582
9974992417,4cyclictest33-21ksoftirqd/223:35:162
9974992417,4cyclictest33-21ksoftirqd/202:39:132
9974992417,4cyclictest19604-21sh01:34:052
9974992417,4cyclictest19604-21sh01:34:052
997499241,20cyclictest20229-21basename01:34:192
997499241,20cyclictest20229-21basename01:34:192
997499240,22cyclictest0-21swapper/200:40:452
9965992417,4cyclictest18860-21sed02:39:251
9961992418,3cyclictest9-21ksoftirqd/001:48:320
9961992418,3cyclictest9-21ksoftirqd/001:48:320
9961992417,4cyclictest9-21ksoftirqd/023:23:260
9961992417,4cyclictest9-21ksoftirqd/022:54:110
9961992417,4cyclictest9-21ksoftirqd/022:11:000
997499236,15cyclictest1067-21lldpd23:15:042
997499233,11cyclictest851-21ssh01:14:172
9974992318,3cyclictest33-21ksoftirqd/203:24:382
9974992318,3cyclictest33-21ksoftirqd/203:24:382
9974992316,4cyclictest33-21ksoftirqd/222:24:432
9974992316,4cyclictest2252-21diskmemload02:21:452
997499231,3cyclictest3081-21diskmemload03:14:102
997499231,19cyclictest3081-21diskmemload00:22:362
9965992316,4cyclictest25-21ksoftirqd/123:35:111
9965992316,4cyclictest25-21ksoftirqd/123:22:191
9965992316,4cyclictest25-21ksoftirqd/123:01:231
9974992215,4cyclictest33-21ksoftirqd/200:08:082
997499221,4cyclictest3081-21diskmemload02:10:072
997499221,4cyclictest28711-21ssh01:42:492
9974992213,6cyclictest27005-21cut02:14:212
9965992216,3cyclictest3506-21bc00:09:161
9965992215,4cyclictest25-21ksoftirqd/123:28:171
996599221,18cyclictest5844-21grep02:59:271
996599220,19cyclictest14919-21sed03:09:291
9961992216,3cyclictest9-21ksoftirqd/023:24:580
996199221,18cyclictest2295-21snmp_o5powerctl01:14:300
997499212,3cyclictest121rcu_preempt03:22:442
9974992116,3cyclictest33-21ksoftirqd/222:44:292
9974992116,3cyclictest33-21ksoftirqd/200:01:222
9974992114,4cyclictest23884-21/usr/sbin/munin23:44:272
9974992114,4cyclictest12110-21sh00:51:212
997499211,3cyclictest8781-21apt-get02:29:202
997499211,18cyclictest32759-21ssh01:46:082
997499211,18cyclictest32759-21ssh01:46:082
9974992111,8cyclictest3081-21diskmemload00:26:172
9974992110,8cyclictest0-21swapper/202:49:402
997499210,20cyclictest0-21swapper/223:39:182
996599218,3cyclictest13221-21cat00:19:171
9965992115,3cyclictest28573-21sh00:34:281
9965992115,3cyclictest25-21ksoftirqd/101:25:321
9965992114,4cyclictest25-21ksoftirqd/122:47:341
9961992115,4cyclictest9-21ksoftirqd/002:52:360
9961992115,3cyclictest28998-21sendmail_mailtr22:44:240
9961992114,4cyclictest7000-21sh03:37:350
9965992014,3cyclictest23486-21if_enp1s0.122:34:211
9961992013,4cyclictest8721-21fschecks_time00:14:190
9965991912,4cyclictest28835-21cut23:54:181
9965991912,4cyclictest28835-21cut23:54:181
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional