You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-08-16 - 05:27

x86 Intel Atom E3845 @1915 MHz, Linux 4.19.37-rt20 (Profile)

Latency plot of system in rack #b, slot #6
Data to construct the above plot have been generated using the RT test utility cyclictest.
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackbslot6.osadl.org (updated Tue Aug 16, 2022 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3106921800,5sleep03162499cyclictest03:05:130
3106921800,5sleep03162499cyclictest03:05:130
1156721580,5sleep33164099cyclictest00:59:443
911911050,4ptp4l401ktimersoftd/321:59:453
91191720,1ptp4l401ktimersoftd/301:24:213
296912670,3sleep09-21ksoftirqd/000:09:060
312612664,10sleep20-21swapper/222:00:182
314142644,10sleep00-21swapper/022:02:180
91191630,1ptp4l401ktimersoftd/323:08:563
241242630,1sleep10-21swapper/122:54:021
31636996214,20cyclictest11820-21sed03:19:262
91191590,1ptp4l401ktimersoftd/302:15:353
91191580,1ptp4l401ktimersoftd/322:54:073
31636995812,25cyclictest7170-21/usr/sbin/munin22:19:062
91191570,1ptp4l401ktimersoftd/322:23:443
91191550,15ptp4l401ktimersoftd/301:09:093
31636995511,20cyclictest26139-21sh01:51:112
23992540,2sleep00-21swapper/023:14:170
226722540,1sleep20-21swapper/223:59:042
226722540,1sleep20-21swapper/223:59:042
313332474,31sleep10-21swapper/122:01:141
3163699466,23cyclictest209662chrt22:46:242
31631994618,8cyclictest25-21ksoftirqd/102:48:511
91191450,1ptp4l401ktimersoftd/323:22:343
91191440,1ptp4l401ktimersoftd/300:19:463
3164099446,12cyclictest18659-21ssh01:44:063
91191430,2ptp4l24286-21kworker/3:022:48:253
91191430,1ptp4l401ktimersoftd/302:40:123
31631994317,5cyclictest25-21ksoftirqd/102:03:551
31631994314,7cyclictest25-21ksoftirqd/101:00:011
31631994311,10cyclictest25-21ksoftirqd/103:19:141
91191420,1ptp4l401ktimersoftd/301:14:073
3163199427,3cyclictest25-21ksoftirqd/102:34:151
31631994225,3cyclictest25-21ksoftirqd/101:09:211
31631994221,4cyclictest25-21ksoftirqd/103:14:091
31631994220,11cyclictest25-21ksoftirqd/123:33:481
31631994216,7cyclictest25-21ksoftirqd/101:14:111
31631994116,8cyclictest25-21ksoftirqd/123:43:471
31631994115,4cyclictest25-21ksoftirqd/100:09:141
91191400,1ptp4l401ktimersoftd/303:29:273
91191400,1ptp4l401ktimersoftd/303:23:263
91191400,1ptp4l401ktimersoftd/302:04:293
91191400,1ptp4l401ktimersoftd/300:27:403
91191400,15ptp4l401ktimersoftd/302:54:073
3163199405,10cyclictest25-21ksoftirqd/103:09:151
31631994019,4cyclictest25-21ksoftirqd/122:08:451
31631994019,4cyclictest25-21ksoftirqd/101:44:131
31631994018,4cyclictest25-21ksoftirqd/101:58:591
31631994016,5cyclictest25-21ksoftirqd/123:54:021
31631994012,8cyclictest25-21ksoftirqd/122:34:081
91191390,1ptp4l401ktimersoftd/323:39:023
91191390,1ptp4l401ktimersoftd/303:05:043
91191390,1ptp4l401ktimersoftd/303:05:043
91191390,1ptp4l401ktimersoftd/302:47:053
91191390,1ptp4l401ktimersoftd/302:33:063
91191390,1ptp4l401ktimersoftd/302:28:053
91191390,1ptp4l401ktimersoftd/301:57:133
91191390,1ptp4l401ktimersoftd/301:50:203
91191390,1ptp4l401ktimersoftd/300:57:513
91191390,1ptp4l401ktimersoftd/300:44:333
91191390,1ptp4l401ktimersoftd/300:16:103
91191390,1ptp4l401ktimersoftd/300:04:553
91191390,1ptp4l401ktimersoftd/300:04:553
91191390,0ptp4l401ktimersoftd/300:49:133
3163199395,4cyclictest25-21ksoftirqd/102:24:161
3163199393,3cyclictest25-21ksoftirqd/102:59:161
3163199391,9cyclictest25-21ksoftirqd/102:14:041
31631993918,4cyclictest25-21ksoftirqd/101:54:071
31631993918,4cyclictest25-21ksoftirqd/101:19:091
31631993915,9cyclictest25-21ksoftirqd/102:54:081
31631993914,5cyclictest25-21ksoftirqd/122:19:091
31631993911,9cyclictest25-21ksoftirqd/102:42:141
91191380,1ptp4l401ktimersoftd/322:09:293
91191380,1ptp4l401ktimersoftd/303:25:063
91191380,1ptp4l401ktimersoftd/303:11:293
91191380,1ptp4l401ktimersoftd/301:34:523
91191380,1ptp4l401ktimersoftd/301:19:233
91191380,0ptp4l401ktimersoftd/302:20:493
91191380,0ptp4l401ktimersoftd/302:00:143
91191380,0ptp4l401ktimersoftd/300:32:203
3163699384,27cyclictest20052-21apt-get23:54:012
3163699380,4cyclictest212-21systemd-journal23:13:472
3163199384,9cyclictest25-21ksoftirqd/122:14:051
31631993826,3cyclictest25-21ksoftirqd/123:04:041
3163199381,7cyclictest25-21ksoftirqd/102:49:141
31631993817,4cyclictest25-21ksoftirqd/123:44:061
31631993817,4cyclictest25-21ksoftirqd/122:13:451
31631993817,4cyclictest25-21ksoftirqd/102:29:261
31631993815,9cyclictest25-21ksoftirqd/100:04:051
31631993815,9cyclictest25-21ksoftirqd/100:04:051
31631993815,4cyclictest25-21ksoftirqd/100:34:091
31631993814,9cyclictest25-21ksoftirqd/123:38:481
31631993814,9cyclictest25-21ksoftirqd/123:09:031
31631993814,4cyclictest25-21ksoftirqd/122:59:071
31631993813,5cyclictest25-21ksoftirqd/122:43:461
31631993811,6cyclictest25-21ksoftirqd/100:53:501
31631993810,3cyclictest25-21ksoftirqd/123:14:001
294962380,5sleep341-21ksoftirqd/300:09:053
91191370,1ptp4l401ktimersoftd/302:59:323
91191370,1ptp4l401ktimersoftd/301:31:213
91191370,0ptp4l401ktimersoftd/302:53:463
91191370,0ptp4l401ktimersoftd/300:35:223
327432370,2sleep20-21swapper/203:08:282
327432370,2sleep20-21swapper/203:08:282
3163699373,26cyclictest15295-21apt-get23:43:592
3163699373,26cyclictest15046-21apt-get00:29:082
3163699372,28cyclictest28600-21apt-get23:04:032
31636993715,19cyclictest13398-21sh00:26:242
3163699370,5cyclictest0-21swapper/202:03:512
3163199376,6cyclictest25-21ksoftirqd/100:48:501
3163199376,3cyclictest25-21ksoftirqd/100:29:181
3163199374,9cyclictest25-21ksoftirqd/100:39:141
31631993725,3cyclictest25-21ksoftirqd/103:04:121
31631993725,3cyclictest25-21ksoftirqd/103:04:121
31631993717,4cyclictest25-21ksoftirqd/122:29:051
31631993717,4cyclictest25-21ksoftirqd/122:29:051
31631993716,4cyclictest25-21ksoftirqd/123:19:021
31631993716,4cyclictest25-21ksoftirqd/101:49:211
31631993715,9cyclictest25-21ksoftirqd/102:09:121
31631993713,4cyclictest25-21ksoftirqd/103:25:391
31631993711,7cyclictest25-21ksoftirqd/101:08:501
91191360,0ptp4l401ktimersoftd/322:33:423
91191360,0ptp4l401ktimersoftd/322:33:423
91191360,0ptp4l401ktimersoftd/302:35:533
3163699368,25cyclictest10352-21sed23:33:482
3163699363,26cyclictest12932-21apt-get23:39:012
3163699362,27cyclictest4431-21apt-get01:29:042
3163199367,5cyclictest25-21ksoftirqd/101:34:071
3163199365,8cyclictest25-21ksoftirqd/101:29:221
3163199364,9cyclictest25-21ksoftirqd/122:49:071
31631993615,4cyclictest25-21ksoftirqd/122:23:571
31631993615,4cyclictest25-21ksoftirqd/102:19:111
31631993614,9cyclictest25-21ksoftirqd/123:24:091
31631993614,4cyclictest25-21ksoftirqd/101:28:501
31631993613,8cyclictest25-21ksoftirqd/103:33:531
31631993612,4cyclictest25-21ksoftirqd/123:49:011
31631993611,4cyclictest25-21ksoftirqd/100:54:051
91191350,1ptp4l401ktimersoftd/303:17:443
3163699357,25cyclictest28374-21cpuspeed_turbos02:29:092
3163699353,26cyclictest18566-21apt-get01:09:082
3163699353,25cyclictest19351-21apt-get03:29:092
31636993516,17cyclictest4015-21sh01:28:492
31636993514,18cyclictest9569-21sh02:43:502
3163699350,4cyclictest31268-21ssh01:22:502
3163199353,7cyclictest25-21ksoftirqd/100:24:261
31631993514,4cyclictest25-21ksoftirqd/100:14:041
31631993513,10cyclictest25-21ksoftirqd/101:39:081
31631993513,10cyclictest25-21ksoftirqd/101:39:081
31631993512,4cyclictest25-21ksoftirqd/122:43:591
91191340,1ptp4l401ktimersoftd/301:07:083
3163699349,22cyclictest5905-21expr03:14:092
3163699342,29cyclictest20405-21grep01:44:242
3163699342,25cyclictest31895-21apt-get22:04:032
3163699342,25cyclictest10567-21apt-get23:34:052
31636993415,16cyclictest8471-21sh00:20:322
31636993414,17cyclictest17581-21sh03:26:182
31636993412,19cyclictest14117-21cut22:33:462
31636993412,19cyclictest14117-21cut22:33:462
3163699340,5cyclictest13907-21sendmail02:13:512
3163699340,4cyclictest29134-21sed00:08:482
3163699340,4cyclictest29134-21sed00:08:482
3163699340,4cyclictest21294-21grep02:54:242
3163699340,4cyclictest14391-21apt-key02:48:522
3163199347,4cyclictest25-21ksoftirqd/100:19:121
153002340,3sleep03162499cyclictest23:44:000
91191330,2ptp4l24286-21kworker/3:023:31:003
91191330,1ptp4l401ktimersoftd/323:49:123
3163699338,21cyclictest16679-21acpi22:38:592
3163699337,23cyclictest6518-21mailstats02:04:252
3163699333,7cyclictest22991-21apt-get01:14:022
3163699332,25cyclictest9612-21apt-get22:23:582
3163699332,24cyclictest24038-21apt-get00:39:022
3163699332,23cyclictest28542-21apt-get00:44:092
31636993313,17cyclictest30040-21sh01:54:492
3163699331,28cyclictest29807-21tune2fs00:09:072
31636993312,18cyclictest23421-21/usr/sbin/munin02:24:142
3163699330,4cyclictest22480-21ssh02:22:502
3163699330,4cyclictest1014-21cpuspeed_turbos03:09:082
3163699330,3cyclictest7121-21latency_hist22:18:462
3163699330,3cyclictest23478-21taskset00:38:332
3163699330,3cyclictest19375-21cat02:53:522
3163199333,7cyclictest25-21ksoftirqd/123:59:031
3163199333,7cyclictest25-21ksoftirqd/123:59:031
91191320,1ptp4l401ktimersoftd/323:34:123
91191320,1ptp4l401ktimersoftd/323:28:413
91191320,1ptp4l401ktimersoftd/322:49:343
91191320,1ptp4l401ktimersoftd/322:24:123
91191320,1ptp4l401ktimersoftd/301:42:433
91191320,1ptp4l401ktimersoftd/301:42:433
91191320,1ptp4l401ktimersoftd/300:39:203
3163699322,26cyclictest9553-21fschecks_time01:34:092
3163699320,4cyclictest26832-21savelog03:01:002
3163699320,3cyclictest4151-21sed22:09:172
3163699320,29cyclictest12123-21ssh01:00:502
3163699318,20cyclictest2678-21sh02:34:562
3163699318,20cyclictest14143-21cpu01:04:102
3163699317,21cyclictest16758-21sh01:41:062
3163699317,21cyclictest16758-21sh01:41:062
3163699311,24cyclictest1532-21apt-get00:14:022
31636993112,16cyclictest5176-21cpuspeed_turbos00:54:072
31636993110,18cyclictest7265-21sed23:24:202
31636993110,18cyclictest18877-21ptp4l23:49:112
3163699310,3cyclictest0-21swapper/200:51:012
3163699308,19cyclictest5391-21cat23:23:472
3163699307,20cyclictest21751-21fschecks_count22:49:052
3163699305,22cyclictest14490-21expr22:34:022
91191290,0ptp4l401ktimersoftd/300:03:413
91191290,0ptp4l401ktimersoftd/300:03:413
3163699291,5cyclictest2206-21/usr/sbin/munin23:14:112
3163699290,3cyclictest27988-21runrttasks23:00:032
91191280,0ptp4l401ktimersoftd/323:16:153
3163699280,25cyclictest16488-21ssh02:15:032
3163699270,5cyclictest24993-21phc2sys-jitter22:54:092
31624992719,5cyclictest9-21ksoftirqd/003:13:560
181032260,21sleep024481-21diskmemload01:43:390
181032260,21sleep024481-21diskmemload01:43:390
91191250,9ptp4l401ktimersoftd/323:47:083
91191250,1ptp4l401ktimersoftd/323:04:043
91191250,1ptp4l401ktimersoftd/322:59:033
91191250,1ptp4l401ktimersoftd/322:34:143
31624992519,3cyclictest7823-21grep00:19:240
224582250,2sleep00-21swapper/001:13:340
91191240,1ptp4l401ktimersoftd/323:54:023
91191240,1ptp4l401ktimersoftd/322:39:143
91191240,1ptp4l401ktimersoftd/322:14:013
91191240,1ptp4l401ktimersoftd/322:04:193
91191240,1ptp4l401ktimersoftd/302:09:273
31624992418,3cyclictest9-21ksoftirqd/023:12:180
3162499241,16cyclictest0-21swapper/001:59:160
3162499234,17cyclictest24725-21sed01:14:210
3162499232,18cyclictest11074-21sed00:24:120
31624992215,4cyclictest9-21ksoftirqd/022:08:470
31624992215,4cyclictest9-21ksoftirqd/000:08:170
31624992215,4cyclictest9-21ksoftirqd/000:08:170
31624992215,4cyclictest899-21runrttasks23:34:100
31624992215,4cyclictest899-21runrttasks02:14:050
31624992215,4cyclictest19117-21apt00:33:490
31624992214,5cyclictest11871-21sh02:44:260
31624992212,7cyclictest24481-21diskmemload01:54:520
3162499221,18cyclictest2653-21tail03:09:260
31624992115,4cyclictest9-21ksoftirqd/022:06:480
31624992115,3cyclictest9-21ksoftirqd/022:26:070
31624992115,3cyclictest24774-21grep22:54:070
31624992114,4cyclictest9-21ksoftirqd/023:40:150
31624992114,4cyclictest26151-21/usr/sbin/munin22:59:130
31624992114,4cyclictest19651-21grep03:29:120
31624992114,4cyclictest11529-21tail02:09:310
31624992114,4cyclictest11165-21kernelversion03:19:150
31624992114,4cyclictest1062-21sed02:34:140
31624992015,3cyclictest9-21ksoftirqd/001:01:420
31624992014,4cyclictest1781-21expr00:14:040
31624992014,3cyclictest9-21ksoftirqd/023:25:250
31624992014,3cyclictest9-21ksoftirqd/002:54:370
31624992014,3cyclictest23564-21expr01:49:060
31624992014,3cyclictest23405-21memory23:59:100
31624992014,3cyclictest23405-21memory23:59:100
31624992014,3cyclictest17587-21/usr/sbin/munin23:49:090
31624992013,4cyclictest7059-21cut22:18:450
31624992013,4cyclictest5341-21cpu02:39:070
31624992013,4cyclictest24815-21cat02:59:170
31624992013,4cyclictest24481-21diskmemload01:04:050
31624992013,4cyclictest24481-21diskmemload00:38:490
31624992013,4cyclictest21699-21expr22:49:030
31624992013,4cyclictest18920-21sh01:44:080
31624992013,4cyclictest15903-21timerwakeupswit22:34:180
31624992013,4cyclictest15020-21expr03:24:100
31624992012,4cyclictest7902-21irqrtprio22:19:050
31624991914,3cyclictest9-21ksoftirqd/022:44:040
31624991913,4cyclictest4650-21cat01:29:050
31624991913,3cyclictest9-21ksoftirqd/022:40:080
31624991913,3cyclictest9169-21phc2sys-jitter23:29:110
31624991913,3cyclictest899-21runrttasks02:04:550
31624991913,3cyclictest32059-21seq00:47:480
31624991913,3cyclictest23584-21cat02:24:100
31624991913,3cyclictest15658-21cut02:49:120
31624991912,4cyclictest3738-21gltestperf23:19:050
31624991912,4cyclictest28798-21expr23:04:050
31624991912,4cyclictest24535-21hddtemp_smartct00:39:070
31624991912,4cyclictest19797-21cat02:19:120
3162499191,15cyclictest6038-21ssh00:54:160
3162499190,17cyclictest24481-21diskmemload01:23:370
3162499190,16cyclictest24481-21diskmemload01:38:010
31624991813,3cyclictest20934-21irqstats23:54:090
31624991812,3cyclictest9-21ksoftirqd/002:29:090
31624991812,3cyclictest24481-21diskmemload01:23:560
31624991812,3cyclictest2276-21timerwakeupswit00:49:260
31624991811,4cyclictest12439-21grep22:29:030
31624991811,4cyclictest12439-21grep22:29:030
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional