You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-03 - 09:41
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackbslot6.osadl.org (updated Mon Nov 03, 2025 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
634721990,7sleep36325-21idleruntime-cro20:06:433
851921650,4sleep0641699cyclictest00:37:110
3264521500,4sleep3643399cyclictest01:05:443
1205521430,5sleep0641699cyclictest00:42:090
177391970,1ptp4l401ktimersoftd/323:31:163
121792760,3sleep10-21swapper/100:06:531
90432720,3sleep20-21swapper/200:37:212
77212640,3sleep30-21swapper/323:26:483
316412610,3sleep233-21ksoftirqd/223:17:032
642299589,20cyclictest10473-21missed_timers01:17:101
177391570,1ptp4l401ktimersoftd/323:46:433
642299569,17cyclictest22838-21snmp_o5powerctl00:17:171
642299569,17cyclictest22838-21snmp_o5powerctl00:17:171
6422995643,7cyclictest25-21ksoftirqd/123:41:591
284312560,1sleep00-21swapper/000:23:420
642299548,18cyclictest13221-21acpi22:56:591
177391540,1ptp4l401ktimersoftd/322:45:063
177391540,1ptp4l401ktimersoftd/322:34:383
177391540,1ptp4l401ktimersoftd/322:34:383
642299538,16cyclictest15610-21ssh23:34:231
642299534,20cyclictest0-21swapper/122:44:221
177391530,9ptp4l401ktimersoftd/320:09:543
111672530,2sleep00-21swapper/023:29:340
642299529,9cyclictest19935-21ssh22:27:201
642299518,18cyclictest26096-21missed_timers00:57:101
205752510,4sleep341-21ksoftirqd/323:04:113
177391510,14ptp4l29022-21kworker/3:122:29:143
642299505,10cyclictest0-21swapper/100:50:441
642299499,10cyclictest3934-21snmp_o5powerctl00:32:161
642299468,9cyclictest9091-21snmp_o5powerctl00:02:191
642299466,11cyclictest31749-21diskmemload01:25:501
177391450,3ptp4l12704-21kworker/3:200:31:343
642299449,9cyclictest30571-21snmp_o5powerctl01:02:171
642299443,9cyclictest0-21swapper/123:28:541
6416994030,5cyclictest9-21ksoftirqd/023:02:030
177391400,1ptp4l401ktimersoftd/322:07:383
642299396,12cyclictest0-21swapper/101:12:091
177391390,0ptp4l401ktimersoftd/323:51:443
177391380,1ptp4l401ktimersoftd/323:32:183
177391380,1ptp4l401ktimersoftd/322:57:503
177391380,1ptp4l401ktimersoftd/322:39:183
177391380,1ptp4l401ktimersoftd/322:12:523
177391380,1ptp4l401ktimersoftd/301:23:163
177391380,1ptp4l401ktimersoftd/300:54:453
177391380,1ptp4l401ktimersoftd/300:43:503
177391380,1ptp4l401ktimersoftd/300:37:153
177391380,1ptp4l401ktimersoftd/300:20:593
177391380,1ptp4l401ktimersoftd/300:20:593
177391380,1ptp4l401ktimersoftd/300:11:333
177391380,0ptp4l401ktimersoftd/300:36:403
6422993725,6cyclictest22107-21apt-get01:32:061
177391370,1ptp4l401ktimersoftd/323:18:273
177391370,1ptp4l401ktimersoftd/323:14:103
177391370,1ptp4l401ktimersoftd/322:17:313
177391370,1ptp4l401ktimersoftd/320:12:133
177391370,1ptp4l401ktimersoftd/301:28:103
177391370,1ptp4l401ktimersoftd/301:12:213
177391370,1ptp4l401ktimersoftd/300:25:083
177391370,1ptp4l401ktimersoftd/300:15:573
177391370,1ptp4l401ktimersoftd/300:15:573
177391370,1ptp4l401ktimersoftd/300:01:503
6427993613,20cyclictest32606-21sh00:28:052
642299368,16cyclictest31749-21diskmemload22:20:071
642299368,14cyclictest3756-21/usr/sbin/munin23:22:051
642299364,13cyclictest0-21swapper/100:25:251
177391360,1ptp4l401ktimersoftd/323:52:383
177391360,1ptp4l401ktimersoftd/323:08:573
177391360,1ptp4l401ktimersoftd/320:47:133
177391360,1ptp4l401ktimersoftd/320:47:133
177391360,1ptp4l401ktimersoftd/301:32:243
177391360,1ptp4l401ktimersoftd/301:08:343
642799352,11cyclictest32313-21cpuspeed_turbos22:06:582
6427993519,13cyclictest33-21ksoftirqd/221:45:142
6427993512,3cyclictest9132-21sed00:02:202
642299356,18cyclictest0-21swapper/120:32:101
642299354,11cyclictest0-21swapper/100:46:021
177391350,1ptp4l401ktimersoftd/300:57:243
177391350,0ptp4l401ktimersoftd/323:38:353
6427993413,3cyclictest5173-21irqrtprio22:12:072
6427993413,3cyclictest3734-21cat22:46:572
6427993413,3cyclictest26893-21sh00:57:222
642299349,14cyclictest17837-21apt-get21:36:571
642299348,10cyclictest1028-21snmpd21:21:251
642299346,12cyclictest0-21swapper/121:57:081
642299343,12cyclictest0-21swapper/122:47:001
6422993422,6cyclictest22621-21apt-get22:31:591
6422993422,6cyclictest22621-21apt-get22:31:591
6422993422,6cyclictest17804-21apt-get23:02:041
6422993415,16cyclictest18879-21python23:37:131
6422993411,19cyclictest16523-21nfs4_client21:32:061
56922348,12sleep00-21swapper/020:02:130
642799339,4cyclictest4323-21proc_pri23:57:112
642799339,4cyclictest22146-21irqrtprio00:17:102
642799339,4cyclictest22146-21irqrtprio00:17:102
642799339,3cyclictest16197-21bc00:47:022
642799338,4cyclictest47050irq/102-ens3-Tx00:07:212
6427993315,15cyclictest33-21ksoftirqd/221:39:442
6427993313,3cyclictest11129-21sh23:29:292
6427993312,4cyclictest22256-21cut01:32:072
6427993312,4cyclictest13858-21sh00:43:112
6427993312,3cyclictest9745-21sed21:17:152
642299339,9cyclictest23211-21irqstats23:07:071
642299335,17cyclictest0-21swapper/120:26:551
642299335,13cyclictest0-21swapper/122:25:501
642299335,11cyclictest0-21swapper/120:57:061
6422993322,6cyclictest8502-21apt-get22:52:001
177391330,1ptp4l401ktimersoftd/322:24:453
177391330,1ptp4l401ktimersoftd/321:22:503
177391330,1ptp4l401ktimersoftd/320:43:593
177391330,1ptp4l401ktimersoftd/320:43:593
642799329,4cyclictest26922-21gltestperf20:47:002
642799329,4cyclictest26922-21gltestperf20:47:002
642799323,10cyclictest16147-21sh23:35:262
6427993212,3cyclictest29615-21sh00:26:012
6427993211,3cyclictest8047-21sh01:14:212
6427993210,3cyclictest6233-21sh23:24:092
6427993210,3cyclictest47050irq/102-ens3-Tx23:39:042
6427993210,3cyclictest14935-21mailstats22:22:112
642799320,8cyclictest0-21swapper/222:37:082
642799320,12cyclictest10394-21/usr/sbin/munin20:12:002
642299329,9cyclictest29190-21ssh23:49:041
642299328,15cyclictest27445-21diskstats22:37:011
642299328,10cyclictest4814-21ssh01:11:131
6422993221,7cyclictest4473-21apt-get22:12:001
6422993221,5cyclictest31334-21apt-get23:17:001
61912322,18sleep21028-21snmpd20:05:092
177391320,1ptp4l401ktimersoftd/323:57:463
177391320,1ptp4l401ktimersoftd/322:54:523
177391320,1ptp4l401ktimersoftd/322:00:283
177391320,1ptp4l401ktimersoftd/321:27:343
177391320,1ptp4l401ktimersoftd/321:17:143
177391320,1ptp4l401ktimersoftd/321:04:003
177391320,1ptp4l401ktimersoftd/300:51:033
642799313,8cyclictest2491-21apt-get00:32:012
6427993125,3cyclictest33-21ksoftirqd/221:26:442
6427993112,3cyclictest28733-21sh23:12:332
6427993112,3cyclictest24776-21cat21:51:462
642799311,16cyclictest31749-21diskmemload01:29:132
6427993111,3cyclictest15964-21sh22:59:042
642299315,11cyclictest0-21swapper/121:22:031
6416993125,3cyclictest9-21ksoftirqd/020:36:430
6416993118,7cyclictest101ktimersoftd/001:17:030
177391310,1ptp4l401ktimersoftd/322:51:343
177391310,1ptp4l401ktimersoftd/321:01:023
177391310,1ptp4l401ktimersoftd/320:54:373
177391310,1ptp4l401ktimersoftd/320:28:293
177391310,0ptp4l401ktimersoftd/321:33:523
642799309,3cyclictest20865-21sh23:04:472
642799308,3cyclictest20648-21tail20:32:052
642799301,8cyclictest6887-21apt-get20:06:542
6422993015,10cyclictest0-21swapper/121:01:571
225682300,4sleep09-21ksoftirqd/020:37:030
177391300,0ptp4l401ktimersoftd/320:32:223
642799299,4cyclictest1760-21runrttasks01:09:472
6427992913,3cyclictest17425-21gltestperf20:27:002
642799291,11cyclictest29152-21diskstats20:52:032
6427992910,3cyclictest23705-21snmp_o5powerctl23:07:122
642299292,11cyclictest0-21swapper/100:00:271
6422992915,11cyclictest0-21swapper/101:27:041
6422992915,10cyclictest18282-21snmp_o5powerctl00:12:161
6422992915,10cyclictest18282-21snmp_o5powerctl00:12:161
6422992913,11cyclictest0-21swapper/121:11:561
57662295,10sleep10-21swapper/120:02:141
177391290,0ptp4l401ktimersoftd/321:47:313
642799287,4cyclictest16789-21cat00:12:022
642799287,4cyclictest16789-21cat00:12:022
642799285,5cyclictest22265-21gltestperf20:37:012
642799282,6cyclictest27321-21apt-get21:56:582
6422992818,6cyclictest9917-21apt-get20:11:551
6422992816,8cyclictest27856-21snmp_o5powerctl20:47:081
6422992816,8cyclictest27856-21snmp_o5powerctl20:47:081
6422992816,8cyclictest21558-21snmp_o5powerctl21:42:151
6422992815,10cyclictest31883-21snmp_o5powerctl00:27:171
641699284,21cyclictest15185-21ssh22:57:320
6416992823,3cyclictest9-21ksoftirqd/000:56:520
6416992822,3cyclictest9-21ksoftirqd/022:52:480
6416992822,3cyclictest9-21ksoftirqd/020:52:230
6416992821,4cyclictest9-21ksoftirqd/021:31:470
177391280,1ptp4l401ktimersoftd/322:02:593
177391280,0ptp4l401ktimersoftd/321:52:483
177391280,0ptp4l401ktimersoftd/321:43:103
6433992721,3cyclictest41-21ksoftirqd/320:39:233
642799276,5cyclictest0-21swapper/201:01:502
6427992722,3cyclictest33-21ksoftirqd/221:30:102
642299277,17cyclictest0-21swapper/123:16:451
6422992722,3cyclictest25-21ksoftirqd/121:07:001
6422992720,4cyclictest25-21ksoftirqd/120:56:351
6422992716,8cyclictest8230-21snmp_o5powerctl20:07:091
6422992716,7cyclictest22051-21snmp_o5powerctl00:52:181
6422992716,7cyclictest12312-21taskset20:16:571
6422992714,9cyclictest24437-21fschecks_count20:42:011
6422992714,9cyclictest24437-21fschecks_count20:42:011
6422992714,10cyclictest1952-21ssh23:55:231
6422992713,10cyclictest0-21swapper/120:36:561
6422992712,11cyclictest32281-21cpuspeed_turbos22:06:581
6422992712,10cyclictest0-21swapper/121:26:591
6416992721,4cyclictest9-21ksoftirqd/021:39:170
6416992721,3cyclictest9-21ksoftirqd/020:15:130
6416992720,4cyclictest9-21ksoftirqd/021:14:120
6416992719,5cyclictest4052-21cut21:07:010
641699270,3cyclictest121rcu_preempt20:11:390
177391270,1ptp4l401ktimersoftd/321:15:543
6427992619,4cyclictest33-21ksoftirqd/220:43:072
6427992619,4cyclictest33-21ksoftirqd/220:43:072
642799260,14cyclictest0-21swapper/201:21:322
6422992619,4cyclictest25-21ksoftirqd/120:21:501
6422992615,8cyclictest7055-21apt-get00:36:531
6422992615,8cyclictest23221-21grep21:47:051
6422992614,9cyclictest25128-21ls21:51:591
6416992621,3cyclictest9-21ksoftirqd/023:22:190
6416992621,3cyclictest9-21ksoftirqd/023:17:040
6416992620,4cyclictest9-21ksoftirqd/021:29:380
6416992620,4cyclictest9-21ksoftirqd/021:26:370
6416992620,3cyclictest9-21ksoftirqd/022:06:020
6416992620,3cyclictest9-21ksoftirqd/021:19:330
6416992620,3cyclictest9-21ksoftirqd/001:26:010
6416992619,4cyclictest9-21ksoftirqd/001:04:490
6433992519,3cyclictest41-21ksoftirqd/320:21:423
6427992519,3cyclictest33-21ksoftirqd/220:26:012
6427992518,4cyclictest33-21ksoftirqd/222:05:052
6427992518,4cyclictest33-21ksoftirqd/221:09:572
6422992513,9cyclictest29704-21wc22:02:021
6416992519,4cyclictest9-21ksoftirqd/023:09:260
6416992519,3cyclictest9-21ksoftirqd/022:49:310
6416992519,3cyclictest9-21ksoftirqd/021:59:360
6416992519,3cyclictest9-21ksoftirqd/021:03:520
6416992519,3cyclictest9-21ksoftirqd/020:21:510
6416992518,4cyclictest9-21ksoftirqd/022:25:540
6427992418,3cyclictest33-21ksoftirqd/221:54:072
6427992418,3cyclictest33-21ksoftirqd/221:33:362
6427992417,4cyclictest6902-21sed21:12:042
642799240,2cyclictest0-21swapper/223:50:302
642799240,13cyclictest47050irq/102-ens3-Tx00:56:352
6416992419,3cyclictest9-21ksoftirqd/022:30:200
6416992418,4cyclictest9-21ksoftirqd/023:16:250
6416992418,3cyclictest9-21ksoftirqd/022:43:250
6416992418,3cyclictest9-21ksoftirqd/021:53:010
6416992418,3cyclictest9-21ksoftirqd/001:30:000
6416992417,4cyclictest9-21ksoftirqd/020:42:530
6416992417,4cyclictest9-21ksoftirqd/020:42:530
6416992417,4cyclictest9-21ksoftirqd/001:14:200
6416992417,4cyclictest9-21ksoftirqd/000:16:430
6416992417,4cyclictest9-21ksoftirqd/000:16:430
6416992416,5cyclictest27178-21irqrtprio20:47:020
6416992416,5cyclictest27178-21irqrtprio20:47:020
177391240,1ptp4l401ktimersoftd/321:06:563
177391240,1ptp4l401ktimersoftd/320:22:053
177391240,1ptp4l401ktimersoftd/301:17:373
177391240,0ptp4l401ktimersoftd/321:39:543
6427992318,3cyclictest33-21ksoftirqd/223:44:502
6427992318,3cyclictest33-21ksoftirqd/201:22:312
6427992316,4cyclictest19008-21irqstats22:27:072
6427992315,5cyclictest22505-21ssh22:31:542
6427992315,5cyclictest22505-21ssh22:31:542
6416992318,3cyclictest9-21ksoftirqd/000:27:080
6416992317,4cyclictest9-21ksoftirqd/020:20:330
6416992317,3cyclictest9-21ksoftirqd/021:01:060
6416992316,4cyclictest9-21ksoftirqd/021:44:030
6416992316,4cyclictest378-21sed22:07:030
6416992311,6cyclictest0-21swapper/000:47:020
6427992217,3cyclictest33-21ksoftirqd/222:56:292
6427992216,3cyclictest33-21ksoftirqd/220:57:382
6416992216,3cyclictest9-21ksoftirqd/022:21:460
6416992216,3cyclictest9-21ksoftirqd/001:32:580
6416992215,4cyclictest21827-21tr00:17:070
6416992215,4cyclictest21827-21tr00:17:070
6427992116,3cyclictest33-21ksoftirqd/222:18:262
6427992116,3cyclictest33-21ksoftirqd/221:04:192
642799210,4cyclictest32438-21snmp_o5powerctl23:52:152
6416992116,3cyclictest9-21ksoftirqd/000:52:080
6416992115,4cyclictest22760-21grep22:32:010
6416992115,4cyclictest22760-21grep22:32:010
6416992115,3cyclictest9-21ksoftirqd/023:52:110
6416992114,4cyclictest17177-21kworker/0:000:36:490
6416992114,4cyclictest13386-21sh00:07:110
6416992014,4cyclictest9-21ksoftirqd/021:47:230
6416992014,4cyclictest4279-21sh01:10:030
6416992013,4cyclictest46850irq/100-ens3-Tx23:36:520
6416992013,4cyclictest31112-21sh22:41:280
641699194,9cyclictest17035-21apt-get20:26:560
6416991913,3cyclictest9775-21sh00:03:000
6416991913,3cyclictest9-21ksoftirqd/023:51:480
6416991913,3cyclictest13211-21tail23:32:050
6416991912,4cyclictest31749-21diskmemload22:15:190
6427991811,4cyclictest2031-21sh22:44:082
6416991812,4cyclictest46850irq/100-ens3-Tx23:42:150
6416991812,3cyclictest7397-21wc00:01:480
6427991711,3cyclictest33-21ksoftirqd/220:18:482
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional