You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-09 - 06:09
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackbslot6.osadl.org (updated Fri May 09, 2025 00:43:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1901821840,4sleep22014999cyclictest00:12:242
846721820,5sleep32015799cyclictest22:10:043
1532421600,3sleep12014399cyclictest02:40:101
1518911230,8ptp4l4958-21kworker/3:221:25:263
151891760,1ptp4l401ktimersoftd/302:54:493
199102704,10sleep00-21swapper/021:28:100
151891690,1ptp4l401ktimersoftd/301:06:033
151891690,1ptp4l401ktimersoftd/300:38:223
151891660,1ptp4l401ktimersoftd/323:41:523
20149996454,5cyclictest33-21ksoftirqd/221:50:002
20149996453,5cyclictest33-21ksoftirqd/223:05:032
20149996450,7cyclictest33-21ksoftirqd/222:39:572
197422644,10sleep20-21swapper/221:25:582
194962630,5sleep219498-21latency_hist22:34:482
20149996252,5cyclictest33-21ksoftirqd/222:09:582
20149996150,4cyclictest33-21ksoftirqd/201:00:032
20149996050,5cyclictest33-21ksoftirqd/223:25:022
151891600,1ptp4l401ktimersoftd/300:33:523
69622580,2sleep00-21swapper/000:35:220
151891580,1ptp4l401ktimersoftd/323:57:253
151891580,1ptp4l401ktimersoftd/302:08:453
20149995747,5cyclictest33-21ksoftirqd/200:55:052
191272570,4sleep019131-21phc2sys-jitter00:50:120
20149995645,6cyclictest33-21ksoftirqd/221:39:562
151891550,1ptp4l401ktimersoftd/301:22:033
100632530,2sleep10-21swapper/101:17:591
2014999526,3cyclictest33-21ksoftirqd/202:50:062
20149995246,3cyclictest33-21ksoftirqd/202:05:062
20149995222,6cyclictest33-21ksoftirqd/200:24:182
151891520,1ptp4l401ktimersoftd/323:15:053
20149995124,4cyclictest33-21ksoftirqd/223:19:482
20149995122,5cyclictest33-21ksoftirqd/222:24:482
2014999507,8cyclictest33-21ksoftirqd/201:39:522
2014999507,8cyclictest33-21ksoftirqd/201:39:522
20149995025,4cyclictest33-21ksoftirqd/202:45:172
20149995024,4cyclictest33-21ksoftirqd/201:10:202
152662500,2sleep20-21swapper/200:09:062
2014999494,3cyclictest121rcu_preempt22:15:152
20149994940,4cyclictest33-21ksoftirqd/223:40:032
20149994925,4cyclictest33-21ksoftirqd/201:09:112
20149994920,6cyclictest33-21ksoftirqd/202:20:222
20149994917,5cyclictest33-21ksoftirqd/221:39:462
20149994825,6cyclictest33-21ksoftirqd/222:29:472
20149994824,4cyclictest33-21ksoftirqd/200:35:012
20149994823,4cyclictest33-21ksoftirqd/223:56:222
20149994823,4cyclictest33-21ksoftirqd/200:29:162
200102484,32sleep10-21swapper/121:29:281
20149994724,3cyclictest33-21ksoftirqd/202:04:472
20149994722,4cyclictest33-21ksoftirqd/222:00:012
20149994722,4cyclictest33-21ksoftirqd/222:00:012
20149994722,4cyclictest33-21ksoftirqd/221:55:032
20149994722,4cyclictest33-21ksoftirqd/202:33:322
20149994722,4cyclictest33-21ksoftirqd/201:26:072
20149994717,9cyclictest33-21ksoftirqd/201:45:182
151891470,1ptp4l401ktimersoftd/301:57:353
2014999463,8cyclictest33-21ksoftirqd/200:40:052
20149994625,7cyclictest33-21ksoftirqd/202:40:162
20149994624,7cyclictest33-21ksoftirqd/201:40:132
20149994621,4cyclictest33-21ksoftirqd/200:15:022
20149994524,6cyclictest33-21ksoftirqd/201:57:472
20149994521,4cyclictest33-21ksoftirqd/202:29:022
20149994521,4cyclictest33-21ksoftirqd/202:18:252
20149994521,4cyclictest33-21ksoftirqd/201:30:412
20149994520,4cyclictest33-21ksoftirqd/202:35:412
20149994519,5cyclictest33-21ksoftirqd/223:46:482
20149994519,5cyclictest33-21ksoftirqd/223:46:482
20149994515,6cyclictest33-21ksoftirqd/223:00:162
20149994438,3cyclictest33-21ksoftirqd/201:19:552
20149994433,3cyclictest33-21ksoftirqd/202:55:162
20149994419,4cyclictest33-21ksoftirqd/222:50:182
20149994419,4cyclictest33-21ksoftirqd/201:18:272
20149994417,3cyclictest33-21ksoftirqd/200:49:512
20149994416,10cyclictest33-21ksoftirqd/223:20:062
2014999434,4cyclictest121rcu_preempt02:14:522
20149994313,9cyclictest33-21ksoftirqd/223:10:042
2014999427,3cyclictest33-21ksoftirqd/222:35:142
2014999425,4cyclictest33-21ksoftirqd/223:30:202
2014999424,8cyclictest33-21ksoftirqd/221:34:462
2014999423,3cyclictest121rcu_preempt23:50:112
2014999423,3cyclictest121rcu_preempt23:50:112
20149994218,4cyclictest33-21ksoftirqd/223:36:292
2014999421,3cyclictest121rcu_preempt22:54:582
20149994213,4cyclictest33-21ksoftirqd/222:05:162
20149994131,3cyclictest33-21ksoftirqd/200:00:012
151891410,1ptp4l401ktimersoftd/300:13:143
2014999406,3cyclictest33-21ksoftirqd/200:50:182
20149994030,3cyclictest33-21ksoftirqd/201:54:352
20149994021,9cyclictest33-21ksoftirqd/200:30:112
2014999400,7cyclictest33-21ksoftirqd/221:45:062
151891400,1ptp4l401ktimersoftd/323:10:153
151891400,1ptp4l401ktimersoftd/322:20:063
151891390,2ptp4l13716-21kworker/3:002:24:533
151891390,1ptp4l401ktimersoftd/301:28:013
151891390,1ptp4l401ktimersoftd/300:52:263
2014999371,3cyclictest121rcu_preempt22:45:022
151891370,4ptp4l401ktimersoftd/302:37:093
151891370,1ptp4l401ktimersoftd/322:39:563
151891370,1ptp4l401ktimersoftd/300:22:353
151891370,0ptp4l401ktimersoftd/302:03:473
151891360,1ptp4l4958-21kworker/3:221:51:063
151891360,1ptp4l401ktimersoftd/322:51:443
151891360,1ptp4l401ktimersoftd/322:15:593
151891360,1ptp4l401ktimersoftd/302:59:173
151891360,1ptp4l401ktimersoftd/302:34:153
151891360,0ptp4l401ktimersoftd/321:46:413
234822350,4sleep023485-21cpuspeed_turbos21:35:000
151891350,1ptp4l401ktimersoftd/302:10:323
151891350,11ptp4l401ktimersoftd/300:44:033
151891340,2ptp4l4958-21kworker/3:201:10:313
151891340,1ptp4l401ktimersoftd/323:00:023
151891340,1ptp4l401ktimersoftd/302:42:113
151891340,1ptp4l401ktimersoftd/301:41:133
151891340,1ptp4l401ktimersoftd/301:34:503
151891340,1ptp4l401ktimersoftd/300:08:323
151891340,1ptp4l13716-21kworker/3:001:48:173
151891340,11ptp4l401ktimersoftd/301:52:063
151891340,0ptp4l401ktimersoftd/300:00:023
20143993328,3cyclictest21708-21cron22:39:471
151891330,1ptp4l401ktimersoftd/323:53:263
151891330,1ptp4l401ktimersoftd/323:53:263
151891330,1ptp4l401ktimersoftd/302:45:073
151891330,1ptp4l401ktimersoftd/301:38:443
151891330,1ptp4l401ktimersoftd/301:38:443
151891330,1ptp4l401ktimersoftd/300:47:223
151891330,0ptp4l401ktimersoftd/301:00:583
20143993224,5cyclictest25-21ksoftirqd/123:04:481
20143993219,3cyclictest25-21ksoftirqd/102:57:241
20143993217,5cyclictest25-21ksoftirqd/100:32:221
151891320,1ptp4l401ktimersoftd/323:45:243
151891320,1ptp4l401ktimersoftd/323:45:243
151891320,1ptp4l401ktimersoftd/323:30:233
151891320,1ptp4l401ktimersoftd/323:23:103
151891320,1ptp4l401ktimersoftd/322:58:363
151891320,1ptp4l401ktimersoftd/300:56:283
151891320,10ptp4l401ktimersoftd/323:36:253
151891310,1ptp4l401ktimersoftd/322:06:583
151891310,1ptp4l401ktimersoftd/321:58:473
151891310,1ptp4l401ktimersoftd/302:27:403
151891310,1ptp4l401ktimersoftd/301:17:303
151891310,0ptp4l401ktimersoftd/302:19:513
300532300,1sleep00-21swapper/023:47:570
300532300,1sleep00-21swapper/023:47:570
205192300,2sleep00-21swapper/002:45:270
151891300,1ptp4l401ktimersoftd/322:45:133
151891300,1ptp4l401ktimersoftd/321:34:183
151891300,0ptp4l401ktimersoftd/322:36:043
20143992922,4cyclictest25-21ksoftirqd/101:04:551
20136992923,3cyclictest9-21ksoftirqd/023:55:030
151891290,1ptp4l401ktimersoftd/323:06:553
151891290,1ptp4l401ktimersoftd/322:32:533
20136992821,4cyclictest9-21ksoftirqd/023:04:490
1590912821,3phc2sys41-21ksoftirqd/300:19:503
151891280,1ptp4l401ktimersoftd/322:24:523
151891280,0ptp4l401ktimersoftd/322:02:043
151891280,0ptp4l401ktimersoftd/322:02:043
20157992721,3cyclictest41-21ksoftirqd/300:27:063
20143992721,3cyclictest25-21ksoftirqd/102:50:551
20143992720,4cyclictest25-21ksoftirqd/123:07:151
20143992720,4cyclictest25-21ksoftirqd/121:54:001
20136992721,3cyclictest9-21ksoftirqd/001:16:460
20136992720,4cyclictest9-21ksoftirqd/021:58:040
2013699271,3cyclictest121rcu_preempt00:22:030
151891270,10ptp4l401ktimersoftd/321:41:023
20157992619,4cyclictest41-21ksoftirqd/321:34:593
20143992620,3cyclictest25-21ksoftirqd/123:26:051
20143992620,3cyclictest25-21ksoftirqd/122:24:301
20143992620,3cyclictest25-21ksoftirqd/122:07:441
20143992619,4cyclictest25-21ksoftirqd/123:39:301
20136992619,4cyclictest9-21ksoftirqd/022:21:330
20136992619,4cyclictest9-21ksoftirqd/022:04:310
20136992619,4cyclictest9-21ksoftirqd/022:04:310
151891260,0ptp4l401ktimersoftd/323:27:183
20143992520,3cyclictest25-21ksoftirqd/100:25:151
20143992519,3cyclictest25-21ksoftirqd/102:17:091
20143992518,4cyclictest25-21ksoftirqd/123:43:441
20143992518,4cyclictest20062-21ssh00:51:001
20136992518,4cyclictest9-21ksoftirqd/022:59:230
20136992518,4cyclictest9-21ksoftirqd/022:31:490
20136992518,4cyclictest9-21ksoftirqd/021:47:410
20143992419,3cyclictest25-21ksoftirqd/123:52:301
20143992419,3cyclictest25-21ksoftirqd/123:52:301
20143992419,3cyclictest25-21ksoftirqd/102:14:511
20143992418,3cyclictest25-21ksoftirqd/122:50:431
20143992418,3cyclictest25-21ksoftirqd/122:42:131
20143992418,3cyclictest25-21ksoftirqd/121:33:311
20143992417,4cyclictest25-21ksoftirqd/101:56:211
20143992410,4cyclictest25-21ksoftirqd/123:47:211
20143992410,4cyclictest25-21ksoftirqd/123:47:211
20136992419,3cyclictest9-21ksoftirqd/023:16:340
20136992419,3cyclictest9-21ksoftirqd/023:14:490
20136992419,3cyclictest9-21ksoftirqd/000:59:510
20136992418,3cyclictest9-21ksoftirqd/023:44:470
20136992417,4cyclictest9-21ksoftirqd/022:38:070
20136992417,4cyclictest9-21ksoftirqd/021:34:040
20136992417,4cyclictest9-21ksoftirqd/002:42:420
2013699240,4cyclictest11420-21ssh01:19:540
20143992318,3cyclictest25-21ksoftirqd/102:06:171
20143992317,3cyclictest25-21ksoftirqd/122:18:571
20143992317,3cyclictest25-21ksoftirqd/122:01:501
20143992317,3cyclictest25-21ksoftirqd/122:01:501
20143992317,3cyclictest25-21ksoftirqd/121:58:571
20143992317,3cyclictest25-21ksoftirqd/121:34:511
20143992317,3cyclictest25-21ksoftirqd/102:34:351
20143992317,3cyclictest25-21ksoftirqd/101:47:421
20143992317,3cyclictest25-21ksoftirqd/100:05:441
20143992316,4cyclictest25-21ksoftirqd/123:09:521
20136992317,4cyclictest9-21ksoftirqd/000:02:140
20136992317,3cyclictest9-21ksoftirqd/023:26:330
20136992317,3cyclictest9-21ksoftirqd/023:23:100
20136992317,3cyclictest9-21ksoftirqd/022:06:160
20136992317,3cyclictest9-21ksoftirqd/021:41:440
20136992317,3cyclictest9-21ksoftirqd/002:57:510
20136992317,3cyclictest9-21ksoftirqd/002:35:590
20136992316,4cyclictest9-21ksoftirqd/022:28:150
20136992316,4cyclictest9-21ksoftirqd/001:04:290
20136992316,4cyclictest9-21ksoftirqd/000:08:560
2013699231,3cyclictest38072sleep023:05:250
2013699230,5cyclictest0-21swapper/000:17:260
20143992216,3cyclictest25-21ksoftirqd/123:16:541
20143992216,3cyclictest25-21ksoftirqd/122:55:381
20143992216,3cyclictest25-21ksoftirqd/122:11:011
20143992216,3cyclictest25-21ksoftirqd/101:53:151
2014399221,3cyclictest31544-21if_enp1s002:20:131
20143992211,8cyclictest16107-21cpuspeed_turbos01:25:061
2013699227,3cyclictest67892sed01:14:510
20136992217,3cyclictest9-21ksoftirqd/023:39:480
20136992217,3cyclictest9-21ksoftirqd/002:26:110
20136992217,3cyclictest25983-21grep22:45:180
20136992216,3cyclictest15422-21grep00:45:210
20136992215,4cyclictest9-21ksoftirqd/022:52:360
20136992215,4cyclictest2779-21sh23:54:490
20136992215,4cyclictest2779-21sh23:54:490
20136992215,4cyclictest13966-21/usr/sbin/munin23:30:090
2013699221,3cyclictest121rcu_preempt00:32:220
20143992116,3cyclictest25-21ksoftirqd/122:47:031
20143992116,3cyclictest25-21ksoftirqd/102:47:561
20143992116,3cyclictest25-21ksoftirqd/101:35:261
20143992116,3cyclictest25-21ksoftirqd/101:35:261
20143992115,4cyclictest25-21ksoftirqd/122:26:161
20143992115,3cyclictest4931-21sed23:55:191
20143992114,4cyclictest25028-21sh00:20:071
20143992114,4cyclictest22385-21tr00:55:061
20143992114,4cyclictest21404-21irqrtprio00:15:061
2014399211,17cyclictest9459-21apt-get00:40:011
2014399211,17cyclictest1046-21sshd23:24:151
2014399211,17cyclictest0-21swapper/101:19:541
2014399210,18cyclictest277432sleep121:40:311
20136992116,3cyclictest10582-21head00:40:100
20136992115,4cyclictest17338-21grep00:10:130
20136992114,4cyclictest6952-21sh01:50:380
20136992114,4cyclictest4390-21sh01:49:200
20136992114,4cyclictest32711-21tail02:20:280
20136992114,4cyclictest29555-21cat00:25:090
20136992114,4cyclictest17784-21/usr/sbin/munin02:05:100
20136992113,4cyclictest22047-21basename02:10:030
20143992014,4cyclictest8939-21sh00:39:311
20143992014,3cyclictest7508-21cpu00:00:031
20143992014,3cyclictest25-21ksoftirqd/102:02:111
20143992014,3cyclictest19740-21sh00:13:581
20143992014,3cyclictest17205-21/usr/sbin/munin22:30:041
20143992014,3cyclictest13630-21/usr/sbin/munin00:45:071
20143992014,3cyclictest10637-21sh02:34:591
20143992013,4cyclictest28308-21/usr/sbin/munin21:44:591
2014399201,16cyclictest30232-21snmp_o5powerctl01:40:201
2014399201,16cyclictest13642-21diskmemload01:30:041
2013699204,10cyclictest30984-21apt-get01:05:050
2013699203,15cyclictest7722-21/usr/sbin/munin22:10:060
20136992014,4cyclictest18176-21sh01:26:180
20136992014,3cyclictest9332-21sh02:32:160
20136992014,3cyclictest9-21ksoftirqd/021:52:410
20136992014,3cyclictest30463-21timerwakeupswit01:40:260
20136992014,3cyclictest29181-21sh02:16:580
20136992014,3cyclictest12279-21sh01:57:550
2013699201,3cyclictest24481-21apt-get01:35:020
2013699201,3cyclictest24481-21apt-get01:35:020
20136992013,4cyclictest24649-21seq02:50:400
20136992013,4cyclictest17047-21sh02:03:580
2013699201,15cyclictest20208-21apt-get01:30:040
2013699201,15cyclictest11493-21python22:15:100
20143991913,4cyclictest26446-21/usr/sbin/munin01:00:101
20143991913,3cyclictest5763-21sh02:28:081
20143991913,3cyclictest16399-21sh23:31:291
2014399190,16cyclictest0-21swapper/101:09:521
2013699192,14cyclictest22441-21gltestperf22:40:010
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional