You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-04 - 07:30
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot6.osadl.org (updated Fri Jul 04, 2025 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2835821810,4sleep01139899cyclictest03:30:450
1777221590,3sleep21141299cyclictest00:15:462
3044421550,4sleep11140499cyclictest00:29:351
1147521540,3sleep01139899cyclictest22:00:430
1462021530,4sleep21141299cyclictest22:05:552
151891960,3ptp4l401ktimersoftd/321:57:053
151891810,1ptp4l401ktimersoftd/302:39:083
151891650,1ptp4l401ktimersoftd/300:45:073
287942640,2sleep10-21swapper/123:41:131
1140499611,26cyclictest4066-21grep01:11:181
1140499610,26cyclictest3339-21cat22:50:451
1140499580,24cyclictest0-21swapper/103:21:541
151891570,1ptp4l401ktimersoftd/303:05:093
151891570,1ptp4l401ktimersoftd/302:58:163
151891570,1ptp4l401ktimersoftd/301:51:273
151891570,1ptp4l401ktimersoftd/301:51:273
151891570,1ptp4l401ktimersoftd/300:12:453
1140499570,22cyclictest0-21swapper/101:17:241
199472560,5sleep31141799cyclictest02:41:173
151891560,1ptp4l401ktimersoftd/323:18:333
151891560,1ptp4l401ktimersoftd/302:28:073
151891560,1ptp4l401ktimersoftd/300:26:593
1140499561,27cyclictest27224-21gzip01:01:131
1140499561,27cyclictest12443-21dpkg00:46:001
1140499560,22cyclictest0-21swapper/103:15:221
231832550,3sleep00-21swapper/002:46:040
1140499556,20cyclictest6277-21switchtime00:01:171
1140499551,24cyclictest24480-21timerandwakeup02:46:191
1140499551,23cyclictest23850-21ssh01:35:091
1140499550,26cyclictest32422-21ssh01:44:291
1139899541,20cyclictest8451-21cpuspeed_turbos23:01:010
1140499531,26cyclictest29105-21/usr/sbin/munin02:16:081
1140499531,23cyclictest892-21ssh01:08:491
1140499530,31cyclictest17611-21/usr/sbin/munin22:11:041
1140499521,24cyclictest19124-21ssh00:52:211
1140499521,24cyclictest1200-21ssh02:56:301
1140499520,22cyclictest9431-21ssh01:55:291
1140499520,22cyclictest9431-21ssh01:55:291
11404995016,22cyclictest18307-21sh02:05:191
1140499501,26cyclictest5273-21awk02:26:071
163612490,2sleep20-21swapper/223:16:052
1140499490,22cyclictest0-21swapper/103:01:161
1140499481,22cyclictest24148-21sensors23:31:111
1140499480,25cyclictest21155-21ssh00:18:411
1140499480,23cyclictest15073-21sensors00:11:131
1140499480,22cyclictest18063-21taskset03:16:331
1139899484,7cyclictest0-21swapper/000:41:060
111922484,32sleep10-21swapper/121:59:281
151891470,1ptp4l401ktimersoftd/303:28:573
1140499471,28cyclictest1505-21runrttasks01:00:411
1140499470,22cyclictest6836-21taskset00:39:141
259812460,1sleep20-21swapper/201:01:032
1140499461,23cyclictest30633-21chrt22:36:171
1140499461,23cyclictest2975-21kworker/u8:002:51:291
1140499460,24cyclictest450-21head02:21:051
136092450,2sleep10-21swapper/123:11:021
1140499450,20cyclictest0-21swapper/101:50:181
1140499450,20cyclictest0-21swapper/101:50:181
11417994438,3cyclictest41-21ksoftirqd/303:06:063
1140499441,30cyclictest9070-21ssh03:06:171
1140499441,22cyclictest4310-21diskmemload01:23:301
1140499441,22cyclictest0-21swapper/100:06:041
1140499441,22cyclictest0-21swapper/100:06:041
1140499440,25cyclictest25215-21/usr/sbin/munin22:26:051
1140499440,23cyclictest16146-21sh02:37:011
1140499432,34cyclictest9452-21apt-get02:31:031
11417994233,4cyclictest41-21ksoftirqd/301:15:593
1140499421,23cyclictest1473-21unixbench_multi23:51:201
1140499420,20cyclictest0-21swapper/101:36:071
1139899423,6cyclictest9-21ksoftirqd/000:31:000
1140499410,28cyclictest19530-21cat02:06:071
1140499410,21cyclictest0-21swapper/101:56:351
1140499410,21cyclictest0-21swapper/100:32:351
1139899413,6cyclictest0-21swapper/000:12:160
151891400,1ptp4l401ktimersoftd/322:51:033
151891400,1ptp4l401ktimersoftd/302:01:023
151891400,1ptp4l401ktimersoftd/300:18:053
1140499400,21cyclictest0-21swapper/122:31:041
151891390,1ptp4l401ktimersoftd/301:34:263
1140499394,26cyclictest24885-21apt-get03:26:041
1139899394,6cyclictest9-21ksoftirqd/003:21:430
151891380,1ptp4l401ktimersoftd/302:31:173
151891380,16ptp4l401ktimersoftd/322:29:483
151891380,0ptp4l401ktimersoftd/300:54:063
1140499380,28cyclictest0-21swapper/102:11:351
1140499380,20cyclictest0-21swapper/123:26:041
1140499380,18cyclictest0-21swapper/100:42:301
1139899384,6cyclictest9-21ksoftirqd/000:18:510
1139899384,17cyclictest29592-21sed01:41:070
151891370,1ptp4l401ktimersoftd/322:46:083
151891370,1ptp4l401ktimersoftd/302:53:173
11417993731,3cyclictest41-21ksoftirqd/323:10:463
1140499373,26cyclictest19444-21apt-get22:15:591
1140499373,26cyclictest19444-21apt-get22:15:591
1140499372,26cyclictest25192-21apt-get23:36:051
11404993716,18cyclictest12281-21sed23:06:181
1140499371,20cyclictest892-21runrttasks22:45:351
1140499370,22cyclictest30919-21sed23:46:081
1139899374,6cyclictest9-21ksoftirqd/022:17:320
1139899374,6cyclictest9-21ksoftirqd/022:17:320
1139899373,6cyclictest9-21ksoftirqd/001:20:480
151891360,1ptp4l401ktimersoftd/302:10:423
151891360,0ptp4l401ktimersoftd/322:11:183
11417993630,3cyclictest41-21ksoftirqd/322:05:433
1140499362,25cyclictest8358-21apt-get23:00:591
1140499360,17cyclictest0-21swapper/102:45:201
1139899364,6cyclictest9-21ksoftirqd/022:34:180
1139899363,7cyclictest9-21ksoftirqd/000:22:360
1139899363,6cyclictest9-21ksoftirqd/023:25:570
1139899363,6cyclictest9-21ksoftirqd/023:06:080
1139899363,6cyclictest9-21ksoftirqd/003:06:190
1139899363,6cyclictest9-21ksoftirqd/002:37:220
1139899363,6cyclictest9-21ksoftirqd/001:52:430
1139899363,6cyclictest9-21ksoftirqd/001:52:430
1139899363,6cyclictest9-21ksoftirqd/001:21:070
1139899363,6cyclictest9-21ksoftirqd/000:52:500
1139899363,5cyclictest9-21ksoftirqd/002:18:050
151891350,2ptp4l24695-21kworker/3:122:39:023
151891350,1ptp4l401ktimersoftd/301:41:573
151891350,1ptp4l401ktimersoftd/300:46:093
151891350,1ptp4l401ktimersoftd/300:21:133
1140499350,21cyclictest22510-21/usr/sbin/munin00:21:081
1139899353,7cyclictest9-21ksoftirqd/001:26:100
1139899353,7cyclictest9-21ksoftirqd/000:56:010
1139899351,19cyclictest20950-21cut01:31:120
3852340,3sleep0111rcuc/022:41:140
151891340,1ptp4l401ktimersoftd/302:24:543
1139899343,7cyclictest9-21ksoftirqd/001:11:050
1139899343,6cyclictest9-21ksoftirqd/003:20:450
1139899343,6cyclictest9-21ksoftirqd/002:06:350
1139899343,5cyclictest9-21ksoftirqd/003:03:420
151891330,1ptp4l401ktimersoftd/323:22:293
151891330,1ptp4l401ktimersoftd/301:46:223
151891330,1ptp4l401ktimersoftd/301:46:223
151891330,1ptp4l401ktimersoftd/301:36:033
151891330,1ptp4l401ktimersoftd/301:26:393
151891330,1ptp4l401ktimersoftd/301:11:023
151891330,1ptp4l401ktimersoftd/301:04:003
151891330,1ptp4l401ktimersoftd/300:04:403
151891330,11ptp4l401ktimersoftd/303:13:263
11412993310,20cyclictest4310-21diskmemload02:46:562
11404993313,17cyclictest7375-21sed22:56:141
1140499331,27cyclictest0-21swapper/123:56:001
1139899334,6cyclictest9-21ksoftirqd/000:29:220
1139899333,6cyclictest9-21ksoftirqd/023:10:460
1139899333,6cyclictest9-21ksoftirqd/022:25:460
1139899333,5cyclictest9-21ksoftirqd/002:51:120
1139899332,6cyclictest9-21ksoftirqd/002:41:440
1139899332,16cyclictest4310-21diskmemload01:46:190
1139899332,16cyclictest4310-21diskmemload01:46:190
2692323224,3sleep233-21ksoftirqd/203:27:022
151891320,1ptp4l401ktimersoftd/323:30:143
151891320,1ptp4l401ktimersoftd/303:25:253
151891320,1ptp4l401ktimersoftd/302:16:483
151891320,1ptp4l401ktimersoftd/302:00:423
11417993225,4cyclictest41-21ksoftirqd/300:06:013
11417993225,4cyclictest41-21ksoftirqd/300:06:013
1140499324,22cyclictest14685-21apt-get22:05:561
11404993214,15cyclictest1505-21runrttasks01:26:021
1140499321,26cyclictest4093-21sed22:51:051
1139899323,6cyclictest9-21ksoftirqd/001:05:240
1139899323,5cyclictest9-21ksoftirqd/002:23:590
1139899322,18cyclictest13338-21ssh03:11:180
92482312,16sleep29167-21/usr/sbin/munin21:55:582
151891310,1ptp4l401ktimersoftd/323:37:563
11417993125,3cyclictest41-21ksoftirqd/300:56:063
11412993125,3cyclictest33-21ksoftirqd/200:06:082
11412993125,3cyclictest33-21ksoftirqd/200:06:082
11404993113,15cyclictest18481-21gltestperf23:21:031
1140499311,26cyclictest12073-21grep22:01:011
1140499310,26cyclictest23874-21basename22:25:441
1140499310,26cyclictest23874-21basename22:25:441
1139899313,6cyclictest9-21ksoftirqd/022:01:100
1139899313,6cyclictest9-21ksoftirqd/002:31:140
1139899313,5cyclictest9-21ksoftirqd/023:19:430
1139899313,5cyclictest9-21ksoftirqd/001:36:150
1139899311,9cyclictest10586-21sendmail_mailtr00:06:120
1139899311,9cyclictest10586-21sendmail_mailtr00:06:120
1139899311,17cyclictest13658-21ssh00:46:100
151891300,0ptp4l401ktimersoftd/323:30:473
1140499300,26cyclictest16755-21grep23:16:071
1139899303,5cyclictest9-21ksoftirqd/023:45:170
1139899303,5cyclictest9-21ksoftirqd/022:59:210
1139899302,6cyclictest9-21ksoftirqd/002:05:110
1139899302,18cyclictest4310-21diskmemload01:56:080
1139899301,17cyclictest1446-21unixbench-2d23:51:200
1139899300,17cyclictest4185-21/usr/sbin/munin00:36:050
290312290,2sleep30-21swapper/323:41:193
159091296,6phc2sys121rcu_preempt00:32:513
11417992924,3cyclictest41-21ksoftirqd/322:31:003
11417992923,3cyclictest41-21ksoftirqd/301:21:053
11417992923,3cyclictest41-21ksoftirqd/301:06:053
11412992923,3cyclictest33-21ksoftirqd/202:01:092
1139899295,8cyclictest9-21ksoftirqd/002:28:550
1139899293,6cyclictest9-21ksoftirqd/002:11:400
1139899293,6cyclictest9-21ksoftirqd/001:06:310
1139899293,6cyclictest9-21ksoftirqd/000:02:310
1139899293,5cyclictest9-21ksoftirqd/002:58:280
151891280,1ptp4l401ktimersoftd/303:17:083
151891280,0ptp4l401ktimersoftd/322:22:393
151891280,0ptp4l401ktimersoftd/322:22:393
11417992822,3cyclictest41-21ksoftirqd/323:51:103
11417992822,3cyclictest41-21ksoftirqd/323:01:063
11417992821,4cyclictest41-21ksoftirqd/322:16:063
11417992821,4cyclictest41-21ksoftirqd/322:16:063
11412992823,3cyclictest33-21ksoftirqd/203:16:102
11412992822,3cyclictest33-21ksoftirqd/222:36:062
11412992822,3cyclictest33-21ksoftirqd/201:23:442
11412992821,4cyclictest33-21ksoftirqd/223:35:362
11412992821,4cyclictest33-21ksoftirqd/222:53:532
11412992821,4cyclictest33-21ksoftirqd/201:05:492
1139899285,8cyclictest9-21ksoftirqd/023:59:190
1139899285,8cyclictest9-21ksoftirqd/022:46:000
11398992811,13cyclictest0-21swapper/023:36:050
159091271,4phc2sys29967-21cpuspeed_turbos23:46:003
151891270,1ptp4l401ktimersoftd/323:10:533
137922270,5sleep213797-21gltestperf23:11:032
11417992722,3cyclictest41-21ksoftirqd/322:56:153
11417992721,3cyclictest41-21ksoftirqd/322:10:433
11417992719,4cyclictest41-21ksoftirqd/300:35:593
11417992715,7cyclictest41-21ksoftirqd/322:40:583
1141299278,3cyclictest8184-21sed01:16:142
11412992721,3cyclictest33-21ksoftirqd/200:44:202
11412992720,4cyclictest33-21ksoftirqd/222:46:542
1139899270,9cyclictest31242-21mailstats23:46:110
59072260,4sleep21141299cyclictest01:14:522
151891260,1ptp4l401ktimersoftd/302:11:033
11412992621,3cyclictest33-21ksoftirqd/201:30:482
11412992620,4cyclictest33-21ksoftirqd/201:00:272
11412992620,3cyclictest33-21ksoftirqd/202:40:122
11412992620,3cyclictest33-21ksoftirqd/200:46:052
11412992620,3cyclictest33-21ksoftirqd/200:03:222
11412992619,4cyclictest33-21ksoftirqd/201:33:112
1141299261,3cyclictest121rcu_preempt02:08:052
1141299261,22cyclictest3585-21snmp_o5powerctl23:56:122
1141299261,22cyclictest29509-21ssh02:16:152
1141299260,3cyclictest121rcu_preempt01:54:122
1141299260,3cyclictest121rcu_preempt01:54:122
1139899265,14cyclictest9-21ksoftirqd/023:32:260
1139899263,6cyclictest9-21ksoftirqd/023:21:070
151891250,1ptp4l401ktimersoftd/302:46:113
11417992520,3cyclictest41-21ksoftirqd/323:56:243
11412992519,3cyclictest33-21ksoftirqd/222:41:502
11412992518,4cyclictest33-21ksoftirqd/223:53:062
11412992518,4cyclictest33-21ksoftirqd/223:06:292
11412992518,4cyclictest33-21ksoftirqd/222:20:122
11412992518,4cyclictest33-21ksoftirqd/222:20:122
1141299251,7cyclictest5082-21ssh02:26:062
1141299251,7cyclictest121rcu_preempt22:31:152
1141299251,5cyclictest462-21snmp_o5powerctl00:31:162
1141299251,21cyclictest28894-21snmp_o5powerctl02:51:182
1141299251,21cyclictest23140-21/usr/sbin/munin00:21:052
1141299251,21cyclictest18064-21apt-get23:20:592
1141299250,22cyclictest25855-21irqrtprio23:36:122
1139899253,6cyclictest9-21ksoftirqd/022:36:120
1139899253,6cyclictest9-21ksoftirqd/022:25:440
1139899253,6cyclictest9-21ksoftirqd/022:25:440
1139899253,6cyclictest9-21ksoftirqd/022:06:060
11412992419,3cyclictest33-21ksoftirqd/223:45:452
11412992418,3cyclictest33-21ksoftirqd/223:48:262
11412992418,3cyclictest33-21ksoftirqd/201:56:192
11412992417,4cyclictest33-21ksoftirqd/222:30:402
11412992417,4cyclictest33-21ksoftirqd/201:47:052
11412992417,4cyclictest33-21ksoftirqd/201:47:052
11412992417,4cyclictest33-21ksoftirqd/201:44:112
1141299241,20cyclictest4949-21snmp_o5powerctl00:36:122
1141299240,21cyclictest28246-21ssh00:26:122
1139899245,8cyclictest9-21ksoftirqd/022:10:580
1139899243,6cyclictest9-21ksoftirqd/022:51:120
1141299233,3cyclictest121rcu_preempt02:14:322
11412992318,3cyclictest25036-1kworker/u9:102:56:102
11412992317,3cyclictest33-21ksoftirqd/200:19:402
11412992316,4cyclictest33-21ksoftirqd/223:29:462
11412992316,4cyclictest33-21ksoftirqd/223:03:322
1141299231,4cyclictest21811-21apt-get22:20:582
1141299231,4cyclictest21811-21apt-get22:20:582
1141299231,19cyclictest10879-21snmp_o5powerctl02:31:162
1141299230,20cyclictest4310-21diskmemload03:22:562
11412992217,3cyclictest33-21ksoftirqd/222:56:052
11412992217,3cyclictest33-21ksoftirqd/201:36:112
11412992216,4cyclictest33-21ksoftirqd/203:11:102
11412992216,3cyclictest33-21ksoftirqd/222:10:482
11412992216,3cyclictest33-21ksoftirqd/202:41:032
11412992213,5cyclictest344-21fschecks_count02:21:052
1141299220,20cyclictest0-21swapper/203:08:042
1141299215,3cyclictest19463-21kworker/2:022:05:432
1141299210,20cyclictest0-21swapper/203:02:282
11412992015,3cyclictest33-21ksoftirqd/200:51:112
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional