You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-05-30 - 10:06

x86 Intel Atom E3845 @1915 MHz, Linux 4.19.37-rt20 (Profile)

Latency plot of system in rack #b, slot #6
Data to construct the above plot have been generated using the RT test utility cyclictest.
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackbslot6.osadl.org (updated Tue May 30, 2023 00:43:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3093821710,4sleep12661999cyclictest01:19:511
1522911620,6ptp4l391rcuc/319:52:123
190621530,4sleep02661499cyclictest01:23:070
3191021490,2sleep02661499cyclictest00:02:380
152291830,1ptp4l391rcuc/322:22:073
152291830,1ptp4l391rcuc/322:22:073
152291820,2ptp4l391rcuc/300:12:323
152291820,2ptp4l391rcuc/300:12:323
152291810,2ptp4l391rcuc/322:07:303
152291810,2ptp4l391rcuc/301:17:253
152291800,1ptp4l391rcuc/320:07:163
152291790,2ptp4l391rcuc/300:32:253
152291790,2ptp4l391rcuc/300:27:153
152291790,1ptp4l391rcuc/301:07:183
152291780,2ptp4l391rcuc/322:52:253
152291780,2ptp4l391rcuc/322:47:273
152291780,2ptp4l391rcuc/300:53:433
152291780,2ptp4l391rcuc/300:22:193
152291780,2ptp4l391rcuc/300:00:473
152291780,1ptp4l391rcuc/323:30:393
152291780,1ptp4l391rcuc/323:02:103
152291780,1ptp4l391rcuc/322:27:243
152291770,1ptp4l391rcuc/322:57:143
152291770,1ptp4l391rcuc/322:33:273
152291770,1ptp4l391rcuc/300:41:473
152291770,1ptp4l391rcuc/300:37:153
152291770,1ptp4l391rcuc/300:07:213
152291770,1ptp4l391rcuc/300:07:213
152291760,2ptp4l391rcuc/321:37:143
152291760,1ptp4l391rcuc/323:42:233
152291760,1ptp4l391rcuc/323:32:203
152291760,1ptp4l391rcuc/323:17:193
152291760,1ptp4l391rcuc/322:37:203
152291760,1ptp4l391rcuc/322:17:063
152291760,1ptp4l391rcuc/321:42:043
152291760,1ptp4l391rcuc/320:12:133
152291760,1ptp4l391rcuc/301:12:323
152291750,1ptp4l391rcuc/323:12:083
152291750,1ptp4l391rcuc/323:11:043
152291750,1ptp4l391rcuc/322:42:263
152291750,1ptp4l391rcuc/322:02:223
152291750,1ptp4l391rcuc/321:52:193
152291750,1ptp4l391rcuc/321:22:213
152291750,1ptp4l391rcuc/320:01:443
152291750,1ptp4l391rcuc/300:50:383
152291740,2ptp4l391rcuc/323:37:113
152291740,1ptp4l391rcuc/322:14:233
152291740,1ptp4l391rcuc/321:57:103
152291740,1ptp4l391rcuc/321:47:203
152291740,1ptp4l391rcuc/321:32:083
152291740,1ptp4l391rcuc/321:17:063
152291740,1ptp4l391rcuc/300:58:203
152291730,1ptp4l391rcuc/323:52:153
152291730,1ptp4l391rcuc/320:32:033
152291730,1ptp4l391rcuc/320:32:033
152291730,1ptp4l391rcuc/300:05:353
152291720,1ptp4l391rcuc/323:47:163
152291720,1ptp4l391rcuc/320:37:223
152291710,1ptp4l391rcuc/321:27:083
152291710,1ptp4l391rcuc/301:03:233
152291700,2ptp4l391rcuc/323:26:053
152291700,1ptp4l391rcuc/320:42:083
152291700,1ptp4l391rcuc/320:27:073
152291700,1ptp4l391rcuc/320:27:073
152291700,1ptp4l391rcuc/320:22:123
152291700,1ptp4l391rcuc/320:00:363
152291700,1ptp4l391rcuc/301:25:193
152291680,2ptp4l391rcuc/320:52:223
152291680,1ptp4l391rcuc/321:02:513
152291680,1ptp4l391rcuc/320:59:023
152291680,1ptp4l391rcuc/320:47:283
152291680,1ptp4l391rcuc/320:20:313
71512670,2sleep10-21swapper/123:34:521
152291670,1ptp4l391rcuc/321:12:163
152291670,1ptp4l391rcuc/321:09:133
152291640,1ptp4l391rcuc/300:19:573
26625996151,5cyclictest33-21ksoftirqd/222:32:062
39782570,2sleep10-21swapper/122:16:151
292632550,2sleep20-21swapper/200:01:072
198792530,2sleep10-21swapper/123:49:221
26012520,5sleep233-21ksoftirqd/222:13:232
263772485,32sleep20-21swapper/219:54:532
26625994230,7cyclictest33-21ksoftirqd/200:22:192
26625994136,3cyclictest33-21ksoftirqd/200:41:502
2661499412,34cyclictest0-21swapper/023:27:080
2661499392,4cyclictest0-21swapper/000:27:040
2661499392,32cyclictest0-21swapper/019:56:560
26614993910,26cyclictest10721-21grep22:22:270
26614993910,26cyclictest10721-21grep22:22:270
2437923917,11sleep09-21ksoftirqd/019:51:440
26625993828,7cyclictest33-21ksoftirqd/223:12:072
2661499389,25cyclictest26455-21gltestperf21:02:110
2661499383,7cyclictest28378-21apt-get21:07:060
2661499382,5cyclictest10849-21apt-get23:02:070
2661499382,4cyclictest0-21swapper/023:07:140
26614993813,22cyclictest570-21/usr/sbin/munin21:17:120
26614993811,24cyclictest26845-21sh22:04:220
2661499380,5cyclictest25201-21unixbench-2d20:57:250
2661499380,5cyclictest11493-21rm23:39:520
2661499380,4cyclictest16800-21latency_hist23:46:450
2661499380,4cyclictest15519-21chrt22:28:230
2661499380,4cyclictest12477-21chrt21:42:020
26625993732,3cyclictest33-21ksoftirqd/200:21:462
26625993714,6cyclictest33-21ksoftirqd/201:17:292
2661499372,7cyclictest17165-21apt-get23:47:080
2661499372,5cyclictest4223-21apt-get23:32:080
26614993713,21cyclictest5269-21sh00:10:470
26614993713,21cyclictest5269-21sh00:10:470
26614993712,22cyclictest24106-21sh23:17:150
26614993711,23cyclictest29310-21cut20:01:410
26614993710,24cyclictest19025-21latency_hist23:11:450
26614993710,24cyclictest15645-21latency_hist01:01:470
2661499370,4cyclictest5297-21irqrtprio20:17:120
2661499370,34cyclictest16790-21grep00:22:490
26625993622,11cyclictest33-21ksoftirqd/200:47:302
2661499366,27cyclictest16385-21fschecks_count01:02:130
2661499362,6cyclictest32020-21apt-get00:42:080
2661499362,3cyclictest0-21swapper/021:12:030
2661499362,31cyclictest21687-21/usr/sbin/munin22:37:170
2661499361,8cyclictest3889-21apt-get00:47:100
2661499361,4cyclictest0-21swapper/020:37:040
2661499361,32cyclictest8545-21if_ens300:52:130
26614993610,23cyclictest26585-21sh01:14:290
26614993610,23cyclictest21456-21tr01:07:240
2661499360,4cyclictest2788-21ssh22:13:460
2661499359,23cyclictest8232-21head21:32:110
2661499359,23cyclictest2996-21/usr/sbin/munin21:22:280
2661499358,24cyclictest6037-21if_ens321:27:100
2661499352,6cyclictest19852-21apt-get21:57:070
2661499352,4cyclictest0-21swapper/020:52:030
2661499352,30cyclictest13808-21latency_hist20:36:400
2661499352,30cyclictest13808-21latency_hist20:36:400
2661499352,28cyclictest0-21swapper/000:32:030
2661499351,4cyclictest0-21swapper/022:52:080
26614993512,20cyclictest46850irq/100-ens3-Tx22:32:160
26614993511,21cyclictest6676-21cpuspeed_turbos22:57:120
26614993510,22cyclictest29906-21grep22:07:270
26614993510,22cyclictest10387-21/usr/sbin/munin00:17:200
2661499350,5cyclictest26095-21perl23:57:090
26625993427,4cyclictest33-21ksoftirqd/200:41:462
2661499349,23cyclictest30557-21cstates22:47:080
2661499348,23cyclictest5406-21irqrtprio22:17:120
2661499348,23cyclictest31285-21sh01:20:370
2661499343,10cyclictest28141-21apt-get23:22:090
2661499341,4cyclictest9067-21latency_hist20:26:400
2661499341,4cyclictest6213-21apt-get00:12:090
2661499341,4cyclictest6213-21apt-get00:12:090
2661499341,29cyclictest20936-21latency_hist20:51:410
26625993328,3cyclictest33-21ksoftirqd/201:01:472
26625993327,3cyclictest33-21ksoftirqd/221:57:082
26625993327,3cyclictest33-21ksoftirqd/201:26:472
26625993327,3cyclictest33-21ksoftirqd/200:31:462
26625993327,3cyclictest33-21ksoftirqd/200:11:452
26625993327,3cyclictest33-21ksoftirqd/200:11:452
26625993320,4cyclictest33-21ksoftirqd/222:42:122
2661499337,22cyclictest166992chrt21:48:040
2661499336,4cyclictest17244-21cat21:52:050
2661499334,3cyclictest32491-21/usr/sbin/munin20:07:080
26625993227,3cyclictest33-21ksoftirqd/222:47:122
26625993227,3cyclictest33-21ksoftirqd/222:41:442
26625993226,4cyclictest33-21ksoftirqd/222:06:422
26625993226,3cyclictest33-21ksoftirqd/223:27:102
26625993226,3cyclictest33-21ksoftirqd/222:17:052
26625993226,3cyclictest33-21ksoftirqd/221:11:412
26625993225,4cyclictest33-21ksoftirqd/223:22:312
26625993225,4cyclictest33-21ksoftirqd/222:27:152
26625993222,5cyclictest33-21ksoftirqd/201:02:072
26625993219,10cyclictest33-21ksoftirqd/200:12:212
26625993219,10cyclictest33-21ksoftirqd/200:12:212
26619993226,3cyclictest25-21ksoftirqd/123:46:441
26619993226,3cyclictest25-21ksoftirqd/120:11:391
2661499327,3cyclictest10729-21if_enp1s0.121:37:120
2661499326,3cyclictest10294-21kernelversion20:27:110
2661499326,3cyclictest10294-21kernelversion20:27:110
2661499320,4cyclictest26496-21grep22:42:120
290012310,5sleep229005-21gltestperf22:07:172
2662599314,3cyclictest33-21ksoftirqd/201:16:472
26625993126,3cyclictest33-21ksoftirqd/223:51:442
26625993126,3cyclictest33-21ksoftirqd/223:07:222
26625993126,3cyclictest33-21ksoftirqd/220:07:122
26625993125,3cyclictest33-21ksoftirqd/223:32:162
26625993125,3cyclictest33-21ksoftirqd/223:06:442
26625993125,3cyclictest33-21ksoftirqd/201:07:152
26619993119,6cyclictest25-21ksoftirqd/122:02:061
2661499318,21cyclictest30075-21sshd00:38:370
2661499316,4cyclictest23003-21switchtime23:52:290
2661499314,4cyclictest17413-21expr20:42:140
26625993025,3cyclictest33-21ksoftirqd/223:42:252
26625993025,3cyclictest33-21ksoftirqd/221:46:432
26625993025,3cyclictest33-21ksoftirqd/221:36:422
26625993025,3cyclictest33-21ksoftirqd/221:21:422
26625993025,3cyclictest33-21ksoftirqd/200:36:462
26625993024,3cyclictest33-21ksoftirqd/222:26:432
26625993024,3cyclictest33-21ksoftirqd/222:26:432
26625993024,3cyclictest33-21ksoftirqd/200:56:032
26625993023,4cyclictest33-21ksoftirqd/223:52:112
26619993024,3cyclictest25-21ksoftirqd/122:17:121
26619993022,4cyclictest25-21ksoftirqd/100:42:081
2661499305,4cyclictest2442-21cstates20:12:030
217662300,4sleep1231rcuc/101:07:311
2662599295,3cyclictest121rcu_preempt21:52:112
26625992924,3cyclictest33-21ksoftirqd/222:56:442
26625992924,3cyclictest33-21ksoftirqd/221:51:422
26625992924,3cyclictest33-21ksoftirqd/220:37:222
26625992924,3cyclictest33-21ksoftirqd/220:01:422
26625992923,3cyclictest33-21ksoftirqd/221:22:152
26625992923,3cyclictest33-21ksoftirqd/221:16:412
26625992923,3cyclictest33-21ksoftirqd/220:57:132
26625992923,3cyclictest33-21ksoftirqd/220:52:082
26625992923,3cyclictest33-21ksoftirqd/220:22:112
26619992924,3cyclictest25-21ksoftirqd/119:57:031
26619992924,3cyclictest25-21ksoftirqd/100:52:061
26619992924,3cyclictest25-21ksoftirqd/100:32:181
26619992923,3cyclictest25-21ksoftirqd/100:51:461
26619992923,3cyclictest25-21ksoftirqd/100:41:461
245272296,10sleep10-21swapper/119:52:011
107072290,2sleep10-21swapper/100:17:081
26625992823,3cyclictest33-21ksoftirqd/221:41:432
26625992823,3cyclictest33-21ksoftirqd/220:32:232
26625992823,3cyclictest33-21ksoftirqd/220:32:232
26625992823,3cyclictest33-21ksoftirqd/220:12:082
26625992822,3cyclictest33-21ksoftirqd/223:37:302
26625992822,3cyclictest33-21ksoftirqd/221:31:422
26625992822,3cyclictest33-21ksoftirqd/220:46:412
26625992822,3cyclictest33-21ksoftirqd/220:21:402
26625992822,3cyclictest33-21ksoftirqd/219:57:152
26625992816,9cyclictest33-21ksoftirqd/223:17:212
26619992823,3cyclictest25-21ksoftirqd/121:57:151
26619992822,3cyclictest25-21ksoftirqd/121:41:031
26625992722,3cyclictest33-21ksoftirqd/221:02:082
26625992722,3cyclictest33-21ksoftirqd/220:27:052
26625992722,3cyclictest33-21ksoftirqd/220:27:052
26625992721,3cyclictest33-21ksoftirqd/200:02:282
2661999273,14cyclictest28514-21ssh22:07:091
26619992721,4cyclictest25-21ksoftirqd/123:26:451
26619992720,4cyclictest46950irq/101-ens3-Tx01:02:171
26619992720,4cyclictest25-21ksoftirqd/121:55:401
2662599263,3cyclictest121rcu_preempt20:47:132
26625992621,3cyclictest33-21ksoftirqd/223:00:432
26619992621,3cyclictest25-21ksoftirqd/123:21:451
26619992621,3cyclictest25-21ksoftirqd/122:40:161
26619992621,3cyclictest25-21ksoftirqd/120:22:221
26619992620,4cyclictest25-21ksoftirqd/100:26:461
26619992620,3cyclictest25-21ksoftirqd/123:54:021
26619992620,3cyclictest25-21ksoftirqd/122:22:141
26619992620,3cyclictest25-21ksoftirqd/122:22:141
26619992620,3cyclictest25-21ksoftirqd/121:46:281
26619992620,3cyclictest25-21ksoftirqd/120:14:291
26619992520,3cyclictest25-21ksoftirqd/123:57:051
26619992520,3cyclictest25-21ksoftirqd/122:57:181
26619992520,3cyclictest25-21ksoftirqd/100:27:061
26619992519,3cyclictest25-21ksoftirqd/121:47:121
26619992519,3cyclictest25-21ksoftirqd/121:21:421
26619992518,4cyclictest25-21ksoftirqd/123:05:421
26619992518,4cyclictest25-21ksoftirqd/121:28:061
26619992518,4cyclictest25-21ksoftirqd/121:21:431
26619992518,4cyclictest25-21ksoftirqd/100:12:101
26619992518,4cyclictest25-21ksoftirqd/100:12:101
26619992516,7cyclictest25-21ksoftirqd/100:04:531
26619992419,3cyclictest25-21ksoftirqd/122:36:431
26619992419,3cyclictest25-21ksoftirqd/121:12:171
26619992419,3cyclictest25-21ksoftirqd/120:32:051
26619992419,3cyclictest25-21ksoftirqd/120:32:051
26619992418,4cyclictest25-21ksoftirqd/120:21:131
26619992418,3cyclictest25-21ksoftirqd/120:51:411
26619992418,3cyclictest25-21ksoftirqd/101:24:041
26619992417,4cyclictest25-21ksoftirqd/122:28:391
26619992416,6cyclictest25-21ksoftirqd/122:42:131
26619992318,3cyclictest25-21ksoftirqd/123:37:191
26619992318,3cyclictest25-21ksoftirqd/120:42:131
26619992318,3cyclictest25-21ksoftirqd/101:12:121
26619992317,3cyclictest25-21ksoftirqd/121:06:411
26619992317,3cyclictest25-21ksoftirqd/120:51:441
26619992316,4cyclictest25-21ksoftirqd/121:00:521
2661999222,12cyclictest12056-21ssh00:57:081
26619992217,3cyclictest25-21ksoftirqd/123:07:221
26619992217,3cyclictest25-21ksoftirqd/122:56:271
26619992217,3cyclictest25-21ksoftirqd/122:51:441
26619992217,3cyclictest25-21ksoftirqd/100:07:251
26619992217,3cyclictest25-21ksoftirqd/100:07:251
26619992216,3cyclictest25-21ksoftirqd/120:37:091
26619992116,3cyclictest25-21ksoftirqd/123:27:171
26619992115,3cyclictest25-21ksoftirqd/120:31:401
26619992115,3cyclictest25-21ksoftirqd/120:31:401
26619992114,5cyclictest25-21ksoftirqd/123:12:131
26619992015,3cyclictest25-21ksoftirqd/121:35:071
26619992014,3cyclictest25-21ksoftirqd/120:05:461
2661999197,9cyclictest25-21ksoftirqd/121:07:181
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional