You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-17 - 21:34
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot6.osadl.org (updated Mon Nov 17, 2025 12:43:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1662222870,5sleep341-21ksoftirqd/308:09:583
487921790,4sleep31869199cyclictest11:22:473
1196821730,4sleep01867399cyclictest10:52:330
3081221510,4sleep31869199cyclictest11:55:033
177391790,1ptp4l401ktimersoftd/310:25:523
18685997359,8cyclictest33-21ksoftirqd/211:30:022
18685997359,7cyclictest33-21ksoftirqd/210:45:012
18685997058,6cyclictest33-21ksoftirqd/211:05:042
177391700,1ptp4l401ktimersoftd/312:40:453
177391660,1ptp4l401ktimersoftd/313:02:233
322442650,3sleep032248-21gltestperf13:10:110
183502644,10sleep00-21swapper/008:11:540
18685996350,6cyclictest33-21ksoftirqd/209:50:002
18685996146,8cyclictest33-21ksoftirqd/208:39:582
18685996146,8cyclictest33-21ksoftirqd/208:39:582
147992610,2sleep30-21swapper/311:35:033
134842610,3sleep10-21swapper/113:25:061
282352600,2sleep30-21swapper/311:50:213
18685996046,7cyclictest33-21ksoftirqd/211:55:032
18685995642,8cyclictest33-21ksoftirqd/211:00:042
16852560,2sleep00-21swapper/009:50:180
288032540,2sleep10-21swapper/111:12:531
137832540,5sleep013778-21ssh10:55:060
18685995239,7cyclictest33-21ksoftirqd/212:45:042
219032510,1sleep00-21swapper/012:21:170
18685995138,7cyclictest33-21ksoftirqd/208:34:592
18685995038,5cyclictest33-21ksoftirqd/213:25:072
18685994836,7cyclictest33-21ksoftirqd/208:54:592
177391480,1ptp4l401ktimersoftd/308:17:013
18673994635,5cyclictest9-21ksoftirqd/010:25:030
18685994539,3cyclictest33-21ksoftirqd/213:04:562
177391450,8ptp4l401ktimersoftd/311:00:363
1786724323,8sleep10-21swapper/108:10:131
177391430,1ptp4l401ktimersoftd/312:46:203
177391410,1ptp4l401ktimersoftd/312:10:013
177391400,1ptp4l401ktimersoftd/312:56:083
1869199396,13cyclictest16281-21ssh10:20:013
18685993925,11cyclictest33-21ksoftirqd/209:25:052
177391390,1ptp4l401ktimersoftd/313:31:493
177391390,1ptp4l401ktimersoftd/311:04:493
177391390,1ptp4l401ktimersoftd/310:45:043
18685993833,3cyclictest33-21ksoftirqd/212:04:492
18685993832,3cyclictest33-21ksoftirqd/212:49:552
1867999380,6cyclictest23176-21/usr/sbin/munin13:35:081
1867999380,5cyclictest18687-21needreboot11:00:131
1867999380,4cyclictest8757-21sh12:44:551
1867999380,4cyclictest23114-21fschecks_time11:45:061
177391380,1ptp4l401ktimersoftd/313:17:003
177391380,1ptp4l401ktimersoftd/313:09:423
177391380,1ptp4l401ktimersoftd/312:50:423
177391380,1ptp4l401ktimersoftd/311:49:423
177391380,1ptp4l401ktimersoftd/310:05:053
177391380,0ptp4l401ktimersoftd/313:29:023
18685993730,4cyclictest33-21ksoftirqd/208:14:442
18685993730,3cyclictest33-21ksoftirqd/212:29:552
18679993712,21cyclictest1760-21runrttasks10:20:311
1867999370,4cyclictest4465-21ssh12:00:421
1867999370,4cyclictest13952-21rm12:12:421
177391370,1ptp4l401ktimersoftd/310:50:013
177391370,0ptp4l401ktimersoftd/312:20:593
18685993631,3cyclictest33-21ksoftirqd/211:39:502
18685993630,3cyclictest33-21ksoftirqd/210:44:482
1867999363,5cyclictest18795-21apt-get11:40:021
1867999362,5cyclictest10607-21snmp_o5powerctl10:50:171
18679993620,13cyclictest25-21ksoftirqd/110:10:461
18679993613,20cyclictest15544-21latency_hist09:14:461
18679993610,23cyclictest592-21fschecks_count12:35:081
1867999360,4cyclictest7998-21rm10:48:001
1867999360,4cyclictest7502-21snmp_o5powerctl08:55:141
1867999360,3cyclictest0-21swapper/113:12:281
177391360,1ptp4l401ktimersoftd/312:33:463
177391360,1ptp4l401ktimersoftd/312:06:133
177391360,1ptp4l401ktimersoftd/311:15:353
177391360,0ptp4l401ktimersoftd/311:27:263
177391360,0ptp4l401ktimersoftd/310:39:533
177391360,0ptp4l401ktimersoftd/310:15:543
290222350,4sleep01867399cyclictest11:13:240
18685993530,3cyclictest33-21ksoftirqd/213:10:112
18685993530,3cyclictest33-21ksoftirqd/212:29:502
18685993530,3cyclictest33-21ksoftirqd/212:10:102
18685993530,3cyclictest33-21ksoftirqd/209:24:462
18685993530,3cyclictest33-21ksoftirqd/209:00:052
18685993529,3cyclictest33-21ksoftirqd/213:15:072
18685993529,3cyclictest33-21ksoftirqd/212:59:522
18685993529,3cyclictest33-21ksoftirqd/211:24:492
18685993528,4cyclictest33-21ksoftirqd/211:50:222
18685993524,9cyclictest33-21ksoftirqd/211:15:222
18685993516,17cyclictest33-21ksoftirqd/210:55:032
1867999359,21cyclictest29935-21irqrtprio08:35:051
1867999352,29cyclictest0-21swapper/111:50:031
18679993511,21cyclictest24115-21ls08:24:451
18679993510,22cyclictest25597-21cat11:09:491
1867999350,4cyclictest8503-21ssh11:26:291
1867999350,4cyclictest5660-21irqstats10:00:071
1867999350,4cyclictest28659-21latency_hist10:34:481
1867999350,4cyclictest28659-21latency_hist10:34:481
1867999350,4cyclictest20695-21ssh12:57:231
1867999350,4cyclictest14215-21munin-run11:34:491
1867999350,3cyclictest29804-21awk09:44:471
18673993522,7cyclictest9-21ksoftirqd/009:14:590
18685993429,3cyclictest33-21ksoftirqd/213:04:512
18685993429,3cyclictest33-21ksoftirqd/212:39:512
18685993429,3cyclictest33-21ksoftirqd/211:44:502
18685993428,3cyclictest33-21ksoftirqd/209:40:042
18685993428,3cyclictest33-21ksoftirqd/209:30:322
18685993423,9cyclictest33-21ksoftirqd/210:05:062
18685993422,10cyclictest33-21ksoftirqd/212:40:102
1867999349,22cyclictest31141-21tail09:45:071
1867999349,22cyclictest28903-21needreboot13:40:171
1867999348,22cyclictest15958-21cpuspeed_turbos09:15:011
1867999342,5cyclictest18291-21apt-get13:30:051
1867999342,29cyclictest19290-21head09:20:111
1867999341,4cyclictest8244-21snmp_o5powerctl12:05:201
18679993412,19cyclictest25220-21sh13:01:561
18679993411,20cyclictest31103-21expr11:55:051
18679993411,20cyclictest30378-21sed10:35:171
18679993410,21cyclictest22697-21latency_hist09:29:461
18679993410,20cyclictest21160-21munin-node12:40:031
177391340,1ptp4l401ktimersoftd/313:38:143
177391340,1ptp4l401ktimersoftd/308:30:133
177391340,11ptp4l401ktimersoftd/310:36:323
177391340,0ptp4l401ktimersoftd/311:14:363
18685993328,3cyclictest33-21ksoftirqd/213:40:172
18685993328,3cyclictest33-21ksoftirqd/213:30:072
18685993328,3cyclictest33-21ksoftirqd/210:35:182
1867999339,21cyclictest13477-21cut10:55:031
1867999331,5cyclictest0-21swapper/112:30:041
1867999331,5cyclictest0-21swapper/108:14:571
18679993311,19cyclictest14816-21ls11:35:031
18679993310,20cyclictest3855-21timerandwakeup09:55:161
1867999330,4cyclictest14097-21ssh10:15:521
177391330,1ptp4l401ktimersoftd/313:13:193
177391330,0ptp4l401ktimersoftd/311:43:353
177391330,0ptp4l401ktimersoftd/310:29:563
177391330,0ptp4l401ktimersoftd/310:29:563
18685993227,3cyclictest33-21ksoftirqd/212:19:502
18685993227,3cyclictest33-21ksoftirqd/212:19:502
18685993227,3cyclictest33-21ksoftirqd/211:25:212
18685993226,3cyclictest33-21ksoftirqd/213:24:522
18685993226,3cyclictest33-21ksoftirqd/211:10:212
18685993226,3cyclictest33-21ksoftirqd/210:50:032
18685993226,3cyclictest33-21ksoftirqd/210:29:482
18685993226,3cyclictest33-21ksoftirqd/209:55:172
18685993226,3cyclictest33-21ksoftirqd/209:15:062
18685993226,3cyclictest33-21ksoftirqd/208:24:592
18685993217,12cyclictest33-21ksoftirqd/210:31:242
18685993217,12cyclictest33-21ksoftirqd/210:31:242
1867999324,4cyclictest0-21swapper/113:15:141
1867999323,26cyclictest0-21swapper/108:50:001
1867999322,4cyclictest30303-21apt-get11:15:051
18679993211,18cyclictest13299-21sh12:50:041
18679993210,19cyclictest1552-21sed10:40:081
177391320,9ptp4l401ktimersoftd/312:35:143
177391320,1ptp4l401ktimersoftd/312:19:383
177391320,1ptp4l401ktimersoftd/312:19:383
177391320,1ptp4l401ktimersoftd/309:43:313
177391320,1ptp4l401ktimersoftd/309:31:283
177391320,1ptp4l401ktimersoftd/308:55:033
177391320,10ptp4l401ktimersoftd/310:57:353
177391320,10ptp4l401ktimersoftd/309:59:403
177391320,0ptp4l401ktimersoftd/313:43:243
177391320,0ptp4l401ktimersoftd/312:25:113
18685993126,3cyclictest33-21ksoftirqd/210:00:072
18685993126,3cyclictest33-21ksoftirqd/208:30:002
18685993126,3cyclictest33-21ksoftirqd/208:20:012
18685993125,3cyclictest33-21ksoftirqd/212:05:112
18685993125,3cyclictest33-21ksoftirqd/211:45:012
18685993120,9cyclictest33-21ksoftirqd/209:04:582
1867999318,20cyclictest2146-21irqrtprio08:45:071
1867999318,20cyclictest19580-21acpi12:20:051
1867999316,4cyclictest3153-21open_files11:20:131
1867999314,21cyclictest16662-21ssh12:15:131
1867999314,21cyclictest16662-21ssh12:15:131
1867999312,7cyclictest8762-21apt-get13:20:071
1867999312,6cyclictest20567-21apt-get10:25:031
1867999312,5cyclictest1383-21snmp_o5powerctl09:50:161
18679993112,16cyclictest28391-21cat13:05:131
18673993125,4cyclictest9-21ksoftirqd/011:19:490
177391310,8ptp4l401ktimersoftd/313:20:523
177391310,0ptp4l401ktimersoftd/309:25:523
243982300,2sleep00-21swapper/009:30:310
18685993025,3cyclictest33-21ksoftirqd/209:45:002
18685993025,3cyclictest33-21ksoftirqd/209:14:462
18685993025,3cyclictest33-21ksoftirqd/208:45:102
18685993024,3cyclictest33-21ksoftirqd/212:24:502
1867999309,18cyclictest31729-21fschecks_count08:40:021
1867999309,18cyclictest31729-21fschecks_count08:40:021
1867999307,20cyclictest27277-21modprobe08:30:041
1867999306,3cyclictest0-21swapper/109:35:041
1867999302,6cyclictest24327-21snmp_o5powerctl09:30:161
1867999302,5cyclictest24358-21apt-get08:24:581
1867999301,5cyclictest0-21swapper/109:00:091
1867999301,4cyclictest25328-21snmp_o5powerctl12:25:181
18673993025,3cyclictest9-21ksoftirqd/012:45:100
18673993023,4cyclictest9-21ksoftirqd/013:35:210
18673993018,6cyclictest9-21ksoftirqd/012:50:040
18685992924,3cyclictest33-21ksoftirqd/213:39:522
18685992924,3cyclictest33-21ksoftirqd/210:20:072
18685992924,3cyclictest33-21ksoftirqd/210:14:472
18685992924,3cyclictest33-21ksoftirqd/209:35:162
18685992924,3cyclictest33-21ksoftirqd/208:50:062
18685992923,3cyclictest33-21ksoftirqd/210:15:052
1867999292,8cyclictest0-21swapper/110:05:041
18673992924,3cyclictest9-21ksoftirqd/012:59:520
18673992924,3cyclictest9-21ksoftirqd/008:45:070
18673992922,4cyclictest9-21ksoftirqd/008:35:110
177391290,0ptp4l401ktimersoftd/309:38:183
18691992821,4cyclictest41-21ksoftirqd/308:25:263
18685992823,3cyclictest33-21ksoftirqd/208:14:572
1867999281,5cyclictest12465-21snmp_o5powerctl09:05:131
18673992822,3cyclictest9-21ksoftirqd/013:17:560
18673992822,3cyclictest9-21ksoftirqd/010:40:210
18673992822,3cyclictest9-21ksoftirqd/009:28:560
18673992822,3cyclictest9-21ksoftirqd/009:10:070
18673992821,4cyclictest9-21ksoftirqd/012:25:590
18673992816,7cyclictest9-21ksoftirqd/011:40:020
18673992815,7cyclictest9-21ksoftirqd/012:55:050
185391281,23phc2sys10190-21irqrtprio10:10:083
177391280,1ptp4l401ktimersoftd/312:01:553
177391280,1ptp4l401ktimersoftd/309:12:433
18691992720,4cyclictest41-21ksoftirqd/310:00:013
18691992720,4cyclictest41-21ksoftirqd/309:18:133
18673992721,3cyclictest9-21ksoftirqd/011:49:260
18673992721,3cyclictest9-21ksoftirqd/011:20:110
18673992721,3cyclictest9-21ksoftirqd/008:28:080
18673992720,4cyclictest9-21ksoftirqd/009:57:570
18673992720,4cyclictest9-21ksoftirqd/009:40:430
18673992720,4cyclictest9-21ksoftirqd/009:36:210
177942270,2sleep00-21swapper/010:20:170
177391270,1ptp4l401ktimersoftd/308:51:113
177391270,0ptp4l401ktimersoftd/308:42:213
177391270,0ptp4l401ktimersoftd/308:42:213
18691992619,4cyclictest41-21ksoftirqd/309:20:223
18691992619,4cyclictest41-21ksoftirqd/309:09:103
18673992621,3cyclictest9-21ksoftirqd/013:30:080
18673992621,3cyclictest9-21ksoftirqd/011:25:340
18673992620,3cyclictest9-21ksoftirqd/009:49:250
18673992620,3cyclictest9-21ksoftirqd/009:09:410
18673992620,3cyclictest9-21ksoftirqd/008:59:460
18673992619,4cyclictest9-21ksoftirqd/012:40:040
18673992619,4cyclictest9-21ksoftirqd/010:11:460
18673992619,4cyclictest9-21ksoftirqd/008:39:530
18673992619,4cyclictest9-21ksoftirqd/008:39:530
18691992519,3cyclictest41-21ksoftirqd/309:49:073
18673992520,3cyclictest9-21ksoftirqd/013:24:520
18673992520,3cyclictest9-21ksoftirqd/011:35:210
18673992520,3cyclictest9-21ksoftirqd/010:15:030
18673992520,3cyclictest9-21ksoftirqd/010:00:040
18673992520,3cyclictest9-21ksoftirqd/009:24:410
18673992519,3cyclictest9-21ksoftirqd/013:27:330
18673992519,3cyclictest9-21ksoftirqd/012:05:060
18673992519,3cyclictest9-21ksoftirqd/008:18:170
18673992518,4cyclictest9-21ksoftirqd/010:45:420
18673992518,4cyclictest9-21ksoftirqd/009:02:130
177391250,1ptp4l401ktimersoftd/311:30:153
177391250,1ptp4l401ktimersoftd/308:36:323
177391250,10ptp4l401ktimersoftd/309:50:423
177391250,10ptp4l401ktimersoftd/309:02:183
18673992419,3cyclictest9-21ksoftirqd/012:17:480
18673992419,3cyclictest9-21ksoftirqd/012:17:480
18673992419,3cyclictest9-21ksoftirqd/011:05:270
18673992418,3cyclictest9-21ksoftirqd/012:35:110
18673992418,3cyclictest9-21ksoftirqd/010:09:320
18673992417,4cyclictest9-21ksoftirqd/008:54:260
18673992417,4cyclictest9-21ksoftirqd/008:33:420
177391240,1ptp4l401ktimersoftd/308:45:103
177391240,1ptp4l401ktimersoftd/308:20:003
18673992318,3cyclictest9-21ksoftirqd/010:35:070
18673992318,3cyclictest9-21ksoftirqd/008:20:040
18673992317,3cyclictest9-21ksoftirqd/013:09:150
18673992317,3cyclictest9-21ksoftirqd/011:04:490
1867399221,8cyclictest0-21swapper/012:10:210
18673992217,3cyclictest9-21ksoftirqd/013:44:520
18673992217,3cyclictest9-21ksoftirqd/011:34:490
18673992217,3cyclictest9-21ksoftirqd/010:30:060
18673992217,3cyclictest9-21ksoftirqd/010:30:060
18673992215,4cyclictest9-21ksoftirqd/011:59:540
18673992116,3cyclictest9-21ksoftirqd/012:30:060
18673992116,3cyclictest9-21ksoftirqd/011:59:500
18673992115,4cyclictest9-21ksoftirqd/011:52:110
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional