You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-05-26 - 08:21
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot6.osadl.org (updated Sun May 26, 2024 00:43:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3105821590,4sleep01670299cyclictest01:27:260
864921440,3sleep01670299cyclictest00:19:040
1531921310,2sleep00-21swapper/021:38:520
1791911070,4ptp4l401ktimersoftd/321:39:203
179191700,1ptp4l401ktimersoftd/301:55:233
42882680,2sleep10-21swapper/102:13:361
179191650,1ptp4l401ktimersoftd/301:36:503
16708996552,5cyclictest25-21ksoftirqd/101:33:471
179191620,1ptp4l401ktimersoftd/322:56:573
16708996149,7cyclictest25-21ksoftirqd/121:48:411
144632614,10sleep20-21swapper/221:38:342
1670299605,11cyclictest14570-21apt-get23:48:450
284292590,2sleep20-21swapper/202:43:322
223102580,2sleep00-21swapper/001:15:570
174282580,3sleep21671299cyclictest22:48:572
1670299544,8cyclictest5008-21sed02:53:570
1670299534,8cyclictest11886-21grep01:03:520
1670299504,6cyclictest12664-21cut00:24:050
252282490,3sleep11670899cyclictest23:59:381
1670299495,6cyclictest2890-21sed00:13:330
1670299492,7cyclictest13960-21needreboot02:24:080
1670299484,7cyclictest21295-21cut01:53:570
1670299484,6cyclictest10472-21expr23:43:420
1670299481,11cyclictest4571-21switchtime23:29:030
1670299480,9cyclictest30102-21python02:04:080
179191470,12ptp4l401ktimersoftd/300:48:533
1670299474,6cyclictest101ktimersoftd/002:34:080
1670299473,8cyclictest27774-21tail22:03:480
1670299473,8cyclictest27774-21tail22:03:480
1670299463,6cyclictest16950-21cpuspeed_turbos02:28:480
1670299454,7cyclictest8821-21cpuspeed_turbos02:18:510
1670299453,7cyclictest17323-21grep01:09:100
1670299453,7cyclictest101ktimersoftd/023:38:490
1670299452,8cyclictest101ktimersoftd/000:33:330
1670299451,7cyclictest101ktimersoftd/001:53:350
1670299444,9cyclictest1204-21sed01:29:090
1670299443,8cyclictest32280-21tail00:48:530
1670299443,6cyclictest17902-21sed21:43:520
1670299442,7cyclictest101ktimersoftd/003:03:540
1670299441,8cyclictest101ktimersoftd/000:03:480
1634424426,8sleep10-21swapper/121:40:111
16708994332,5cyclictest25-21ksoftirqd/102:13:501
1670299434,7cyclictest8290-21sed00:58:560
1670299433,9cyclictest20364-21sed00:33:550
1670299433,8cyclictest27851-21expr00:43:470
1670299433,7cyclictest23886-21fschecks_time00:38:510
1670299433,7cyclictest18843-21sed22:53:320
1670299433,6cyclictest28610-21latency_hist02:43:360
1670299432,7cyclictest101ktimersoftd/022:59:020
1670299431,6cyclictest3411-21acpi00:53:450
179191420,1ptp4l401ktimersoftd/302:19:013
1670299423,6cyclictest101ktimersoftd/021:58:290
1670299423,5cyclictest1877-21cat22:18:300
1670299422,9cyclictest101ktimersoftd/002:08:520
1670299422,8cyclictest2021-21grep23:23:570
1670299422,6cyclictest101ktimersoftd/001:58:470
1670299422,6cyclictest101ktimersoftd/001:18:460
179191410,1ptp4l401ktimersoftd/323:25:333
1670299413,6cyclictest9-21ksoftirqd/021:48:460
1670299412,6cyclictest9-21ksoftirqd/021:59:030
1670299412,6cyclictest10939-21latency_hist03:03:360
1670299405,5cyclictest6933-21cat00:18:330
1670299402,8cyclictest7406-21latency_hist01:38:340
1670299402,8cyclictest31770-21sed23:18:540
1670299402,7cyclictest4804-21gltestperf22:23:450
1670299401,8cyclictest15082-21expr03:08:480
1670299401,7cyclictest17729-21cat22:49:050
1670299400,8cyclictest101ktimersoftd/023:08:510
179191390,1ptp4l401ktimersoftd/302:29:363
179191390,1ptp4l401ktimersoftd/301:51:593
179191390,1ptp4l401ktimersoftd/300:18:123
16708993934,3cyclictest25-21ksoftirqd/101:43:391
16708993934,3cyclictest25-21ksoftirqd/101:43:391
16708993928,5cyclictest25-21ksoftirqd/100:43:461
1670299392,8cyclictest6240-21sed02:14:190
1670299392,5cyclictest9-21ksoftirqd/023:55:250
179191380,1ptp4l401ktimersoftd/323:59:423
179191380,1ptp4l401ktimersoftd/301:22:163
179191380,1ptp4l401ktimersoftd/301:09:393
179191380,1ptp4l401ktimersoftd/300:57:473
179191380,1ptp4l401ktimersoftd/300:39:533
179191380,1ptp4l401ktimersoftd/300:30:293
179191380,1ptp4l401ktimersoftd/300:19:203
16708993825,10cyclictest25-21ksoftirqd/123:33:471
1670299382,8cyclictest9442-21expr22:33:430
1670299382,8cyclictest4209-21date22:23:300
1670299380,5cyclictest9-21ksoftirqd/002:43:500
179191370,1ptp4l401ktimersoftd/323:49:273
179191370,1ptp4l401ktimersoftd/303:03:483
179191370,1ptp4l401ktimersoftd/302:25:393
179191370,1ptp4l401ktimersoftd/301:59:233
179191370,1ptp4l401ktimersoftd/301:05:243
179191370,1ptp4l401ktimersoftd/300:46:003
179191370,1ptp4l401ktimersoftd/300:26:003
179191370,1ptp4l401ktimersoftd/300:07:503
179191370,13ptp4l401ktimersoftd/301:33:213
179191370,0ptp4l401ktimersoftd/302:54:363
179191370,0ptp4l401ktimersoftd/302:10:033
16708993732,3cyclictest25-21ksoftirqd/102:48:571
16708993732,3cyclictest25-21ksoftirqd/101:13:331
16708993727,5cyclictest25-21ksoftirqd/101:28:451
16708993726,9cyclictest25-21ksoftirqd/121:53:561
16708993713,3cyclictest25-21ksoftirqd/123:13:501
1670299374,6cyclictest0-21swapper/002:48:480
1670299371,6cyclictest101ktimersoftd/000:03:320
179191360,2ptp4l7384-21kworker/3:123:46:253
179191360,1ptp4l401ktimersoftd/301:25:003
16708993631,3cyclictest25-21ksoftirqd/100:43:331
16708993625,3cyclictest25-21ksoftirqd/100:08:491
16708993623,10cyclictest25-21ksoftirqd/102:29:161
16702993629,4cyclictest30528-21cron23:18:310
1670299362,5cyclictest9-21ksoftirqd/001:44:030
1670299362,5cyclictest9-21ksoftirqd/001:44:030
179191350,1ptp4l401ktimersoftd/303:12:583
179191350,1ptp4l401ktimersoftd/301:18:133
179191350,12ptp4l401ktimersoftd/300:36:143
1670899356,4cyclictest25-21ksoftirqd/102:23:511
16708993530,3cyclictest25-21ksoftirqd/102:23:361
16708993529,3cyclictest25-21ksoftirqd/103:13:361
16708993529,3cyclictest25-21ksoftirqd/102:43:371
16708993529,3cyclictest25-21ksoftirqd/101:23:531
16708993529,3cyclictest25-21ksoftirqd/101:03:531
16708993528,3cyclictest25-21ksoftirqd/100:03:511
1670299352,7cyclictest5754-21cstates23:33:450
179191340,2ptp4l7384-21kworker/3:102:39:073
179191340,2ptp4l7384-21kworker/3:100:10:223
179191340,1ptp4l401ktimersoftd/323:57:333
179191340,1ptp4l401ktimersoftd/302:14:103
16708993429,3cyclictest25-21ksoftirqd/123:48:321
16708993429,3cyclictest25-21ksoftirqd/103:08:361
16708993428,3cyclictest25-21ksoftirqd/102:03:351
16708993427,4cyclictest25-21ksoftirqd/123:23:481
179191330,1ptp4l401ktimersoftd/322:59:443
179191330,1ptp4l401ktimersoftd/322:53:313
179191330,1ptp4l401ktimersoftd/322:05:023
179191330,1ptp4l401ktimersoftd/322:05:023
179191330,1ptp4l401ktimersoftd/302:06:483
1670899336,3cyclictest25-21ksoftirqd/101:58:351
16708993328,3cyclictest25-21ksoftirqd/123:43:311
16708993328,3cyclictest25-21ksoftirqd/122:58:431
16708993328,3cyclictest25-21ksoftirqd/122:33:301
16708993328,3cyclictest25-21ksoftirqd/103:03:361
16708993328,3cyclictest25-21ksoftirqd/102:53:481
16708993328,3cyclictest25-21ksoftirqd/101:18:571
16708993328,3cyclictest25-21ksoftirqd/101:18:341
16708993327,3cyclictest25-21ksoftirqd/123:28:571
16708993327,3cyclictest25-21ksoftirqd/122:53:311
16708993327,3cyclictest25-21ksoftirqd/122:18:531
16708993327,3cyclictest25-21ksoftirqd/100:48:571
179191320,1ptp4l401ktimersoftd/323:30:243
179191320,1ptp4l401ktimersoftd/323:10:363
179191320,1ptp4l401ktimersoftd/322:47:393
179191320,1ptp4l401ktimersoftd/302:59:203
179191320,1ptp4l401ktimersoftd/301:45:103
179191320,1ptp4l401ktimersoftd/301:45:103
179191320,0ptp4l401ktimersoftd/323:22:533
1670899325,3cyclictest25-21ksoftirqd/100:23:331
1670899324,4cyclictest25-21ksoftirqd/101:03:341
16708993228,2cyclictest25-21ksoftirqd/121:48:291
16708993227,3cyclictest25-21ksoftirqd/123:08:511
16708993226,4cyclictest25-21ksoftirqd/101:39:151
16708993226,4cyclictest25-21ksoftirqd/101:39:151
16708993226,3cyclictest25-21ksoftirqd/101:53:341
16708993226,3cyclictest25-21ksoftirqd/100:28:551
179191310,0ptp4l401ktimersoftd/322:34:313
16723993124,4cyclictest41-21ksoftirqd/321:53:293
1670899316,7cyclictest25-21ksoftirqd/122:13:401
1670899315,3cyclictest25-21ksoftirqd/102:04:071
16708993126,3cyclictest25-21ksoftirqd/123:49:091
16708993126,3cyclictest25-21ksoftirqd/100:53:471
16708993126,3cyclictest25-21ksoftirqd/100:33:541
16708993125,3cyclictest25-21ksoftirqd/122:44:081
16708993125,3cyclictest25-21ksoftirqd/102:43:561
16708993125,3cyclictest25-21ksoftirqd/100:28:331
16708993124,3cyclictest25-21ksoftirqd/123:58:321
1670299310,8cyclictest963-21snmpd22:09:030
179191300,1ptp4l401ktimersoftd/301:43:043
179191300,1ptp4l401ktimersoftd/301:43:043
179191300,0ptp4l401ktimersoftd/322:31:283
179191300,0ptp4l401ktimersoftd/301:00:343
16708993025,3cyclictest25-21ksoftirqd/122:38:501
16708993025,3cyclictest25-21ksoftirqd/100:13:431
1670899302,4cyclictest25-21ksoftirqd/123:18:451
16708993024,3cyclictest25-21ksoftirqd/123:03:421
16708993024,3cyclictest25-21ksoftirqd/122:33:501
16708993024,3cyclictest25-21ksoftirqd/122:09:021
1670299305,8cyclictest9-21ksoftirqd/001:42:470
1670299305,8cyclictest9-21ksoftirqd/001:42:470
1670299304,7cyclictest9-21ksoftirqd/022:38:560
16712992923,3cyclictest33-21ksoftirqd/200:01:362
16708992924,3cyclictest25-21ksoftirqd/122:53:321
16708992924,3cyclictest25-21ksoftirqd/122:23:491
16708992924,3cyclictest25-21ksoftirqd/102:33:531
16708992923,3cyclictest25-21ksoftirqd/121:58:301
1670299290,6cyclictest101ktimersoftd/022:29:030
56802280,2sleep20-21swapper/200:55:122
54572280,4sleep25460-21needreboot22:23:522
179191280,1ptp4l401ktimersoftd/323:38:593
16723992821,4cyclictest41-21ksoftirqd/323:16:363
16723992820,5cyclictest41-21ksoftirqd/323:08:313
16708992823,3cyclictest25-21ksoftirqd/122:08:291
16708992823,3cyclictest25-21ksoftirqd/122:08:291
179191270,1ptp4l401ktimersoftd/302:50:423
179191270,0ptp4l401ktimersoftd/321:57:103
16712992721,3cyclictest33-21ksoftirqd/222:43:112
16712992721,3cyclictest33-21ksoftirqd/222:07:002
16712992721,3cyclictest33-21ksoftirqd/222:07:002
16712992720,4cyclictest33-21ksoftirqd/222:33:122
16712992720,4cyclictest33-21ksoftirqd/203:13:112
1670299277,6cyclictest9-21ksoftirqd/023:05:190
16702992720,4cyclictest9-21ksoftirqd/022:45:220
16723992620,3cyclictest41-21ksoftirqd/323:37:023
16723992620,3cyclictest41-21ksoftirqd/302:37:523
16723992619,4cyclictest41-21ksoftirqd/321:48:003
179191250,1ptp4l401ktimersoftd/322:39:033
179191250,1ptp4l401ktimersoftd/322:24:103
179191250,1ptp4l401ktimersoftd/322:21:423
179191250,1ptp4l401ktimersoftd/322:17:353
179191250,1ptp4l401ktimersoftd/302:45:453
16723992519,3cyclictest41-21ksoftirqd/322:09:583
1671299253,13cyclictest11535-21ssh01:03:462
16712992519,3cyclictest33-21ksoftirqd/221:58:352
16712992519,3cyclictest33-21ksoftirqd/221:55:362
16712992519,3cyclictest33-21ksoftirqd/202:31:472
16712992519,3cyclictest18174-21sh23:52:562
16712992518,4cyclictest33-21ksoftirqd/223:28:082
16712992518,4cyclictest33-21ksoftirqd/222:47:332
16712992518,4cyclictest33-21ksoftirqd/222:14:172
3104422419,2sleep233-21ksoftirqd/202:45:172
179191240,0ptp4l401ktimersoftd/321:58:443
16712992419,3cyclictest33-21ksoftirqd/223:46:232
16712992418,3cyclictest33-21ksoftirqd/223:30:592
16712992418,3cyclictest33-21ksoftirqd/222:22:042
16712992418,3cyclictest33-21ksoftirqd/222:09:372
16712992417,4cyclictest33-21ksoftirqd/200:12:282
16712992318,3cyclictest33-21ksoftirqd/200:38:482
16712992317,3cyclictest33-21ksoftirqd/223:56:462
16712992317,3cyclictest33-21ksoftirqd/201:59:252
16712992317,3cyclictest33-21ksoftirqd/201:46:592
16712992317,3cyclictest33-21ksoftirqd/201:46:592
16712992317,3cyclictest33-21ksoftirqd/200:32:582
16712992316,4cyclictest33-21ksoftirqd/221:52:092
16712992316,4cyclictest33-21ksoftirqd/201:20:572
16712992315,5cyclictest47050irq/100-ens3-Tx02:03:482
1671299231,4cyclictest14293-21snmp_o5powerctl02:24:162
16712992217,3cyclictest33-21ksoftirqd/201:29:002
16712992216,3cyclictest33-21ksoftirqd/201:27:342
16712992216,3cyclictest33-21ksoftirqd/200:45:242
16712992216,3cyclictest19299-21sh01:13:332
16712992215,5cyclictest33-21ksoftirqd/201:35:002
16712992215,4cyclictest33-21ksoftirqd/222:54:392
16712992215,4cyclictest33-21ksoftirqd/200:17:542
16712992214,4cyclictest10447-21unixbench_multi02:19:192
238442210,1sleep20-21swapper/201:57:552
1671299211,9cyclictest0-21swapper/202:53:482
1671299211,4cyclictest9373-21ssh00:20:052
16712992114,4cyclictest22134-21sed22:58:512
1671299211,3cyclictest826-21snmp_o5powerctl00:49:102
1671299211,2cyclictest0-21swapper/200:04:012
1671299206,11cyclictest24691-21latency23:03:502
16712992015,3cyclictest7531-21/usr/sbin/munin02:59:132
16712992015,3cyclictest33-21ksoftirqd/202:48:502
1671299201,4cyclictest22442-21ssh00:37:012
16712992014,3cyclictest5457-21/usr/sbin/munin23:33:562
16712992014,3cyclictest33-21ksoftirqd/223:19:002
16712992014,3cyclictest33-21ksoftirqd/223:09:282
16712992014,3cyclictest33-21ksoftirqd/221:47:382
16712992014,3cyclictest3002-21sh02:11:002
16712992014,3cyclictest16859-21irqrtprio01:48:542
16712992013,4cyclictest8111-21fschecks_time01:38:522
16712992013,4cyclictest8111-21fschecks_time01:38:522
16712992013,4cyclictest5211-21sh02:14:012
16712992013,4cyclictest33-21ksoftirqd/222:35:362
16712992013,4cyclictest11638-21fschecks_count03:03:542
1671299201,16cyclictest0-21swapper/201:00:222
16712991914,3cyclictest13237-21sh00:24:352
16712991913,3cyclictest22099-21ls02:34:012
16712991912,4cyclictest8114-21expr23:38:452
1671299191,16cyclictest0-21swapper/223:16:472
1671299191,16cyclictest0-21swapper/201:13:422
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional