You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-06-09 - 03:59

x86 Intel Atom x6425E @2000 MHz, Linux 5.15.49-rt47 (Profile)

Latency plot of system in rack #e, slot #3
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot3 (updated Fri Jun 09, 2023 00:43:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2870517997041,27cyclictest3040302-21kworker/2:000:05:332
287051799670,66cyclictest0-21swapper/219:48:382
2870517996662,2cyclictest0-21swapper/221:26:022
2870517996662,2cyclictest0-21swapper/219:13:372
2870517996545,18cyclictest2879481-21kworker/2:220:00:172
287051799650,63cyclictest0-21swapper/223:04:012
2870517996462,1cyclictest0-21swapper/222:37:552
2870517996461,2cyclictest0-21swapper/223:07:442
2870517996461,2cyclictest0-21swapper/220:13:372
287051799640,63cyclictest0-21swapper/223:28:102
2870517996338,21cyclictest3049480-21kworker/2:200:35:002
287051799630,1cyclictest0-21swapper/220:31:372
2870517996159,1cyclictest0-21swapper/222:47:072
2870517996042,17cyclictest607613-1kworker/2:2H22:29:592
2870517995939,18cyclictest607613-1kworker/2:2H20:39:592
2870521995848,7cyclictest602597-1kworker/3:0H23:07:283
2870517995841,16cyclictest2997563-21kworker/2:223:15:002
2870517995841,16cyclictest2912143-21kworker/2:221:15:022
2870521995752,3cyclictest602597-1kworker/3:0H22:00:213
2870517995755,1cyclictest0-21swapper/220:20:542
2870517995742,14cyclictest3045095-21kworker/2:100:11:372
2870517995742,14cyclictest2903294-21kworker/2:021:05:242
2870517995741,15cyclictest3027240-21kworker/2:223:55:222
2870517995741,15cyclictest2974798-21kworker/2:022:42:262
2870517995741,15cyclictest2891527-21kworker/2:020:20:002
2870517995731,24cyclictest2912143-21kworker/2:221:20:012
2870517995641,14cyclictest3010484-21kworker/2:023:30:012
2870517995641,14cyclictest2997563-21kworker/2:223:22:302
2870517995641,14cyclictest2974798-21kworker/2:023:00:012
2870517995641,14cyclictest2889683-21kworker/2:120:10:012
2870517995640,15cyclictest2879481-21kworker/2:219:50:022
2870517995629,26cyclictest2879481-21kworker/2:219:40:212
2870517995627,26cyclictest4066084-21systemd-journal19:30:002
2870517995540,14cyclictest2997563-21kworker/2:223:15:282
2870517995540,14cyclictest2974798-21kworker/2:022:50:212
2870517995540,14cyclictest2956829-21kworker/2:122:15:302
2870517995540,14cyclictest2927150-21kworker/2:121:42:172
2870517995540,14cyclictest2903294-21kworker/2:020:55:262
2870517995540,14cyclictest2896227-21kworker/2:120:27:372
2870517995540,14cyclictest2879481-21kworker/2:219:35:172
2870517995540,14cyclictest2879481-21kworker/2:219:35:172
2870517995540,14cyclictest2870622-21kworker/2:019:18:372
2870517995539,15cyclictest2952656-21kworker/2:022:05:372
2870517995539,15cyclictest2927150-21kworker/2:121:50:002
2870517995539,15cyclictest2927150-21kworker/2:121:35:012
2870517995539,14cyclictest607613-1kworker/2:2H20:45:212
2870517995537,16cyclictest2956829-21kworker/2:122:30:232
2870517995535,19cyclictest2927150-21kworker/2:121:35:222
287051799551,53cyclictest0-21swapper/222:00:362
2870517995439,14cyclictest3045095-21kworker/2:100:15:222
2870517995439,14cyclictest3027240-21kworker/2:200:00:042
2870517995439,14cyclictest2952656-21kworker/2:022:10:012
2870517995439,14cyclictest2927150-21kworker/2:121:45:012
2870517995438,15cyclictest2903294-21kworker/2:020:50:212
2870517995438,15cyclictest2879481-21kworker/2:220:00:012
2870517995438,15cyclictest2870622-21kworker/2:019:20:332
2870517995437,16cyclictest2903294-21kworker/2:021:10:202
2870517995437,16cyclictest2870622-21kworker/2:019:30:192
2870512995449,3cyclictest2993005-21kworker/0:023:14:020
2870512995449,3cyclictest2928391-21kworker/0:221:40:050
2870517995349,2cyclictest3053173-21fschecks_count00:20:172
2870517995338,14cyclictest3010484-21kworker/2:023:35:012
2870517995338,14cyclictest2901270-21kworker/2:220:41:372
2870517995337,15cyclictest3022812-21kworker/2:123:40:062
2870517995337,15cyclictest2946748-21kworker/2:022:00:002
2870517995336,16cyclictest2956829-21kworker/2:122:20:192
287051799530,51cyclictest2908714-21fschecks_count21:00:212
2870514995348,3cyclictest87634-1kworker/1:2H19:20:001
2870514995348,3cyclictest2926733-21kworker/1:022:37:551
2870512995349,3cyclictest3014252-21kworker/0:023:30:370
2870512995348,3cyclictest2908147-21kworker/0:221:01:370
2870521995240,3cyclictest602597-1kworker/3:0H19:20:213
2870517995237,14cyclictest3049480-21kworker/2:200:35:012
2870517995237,14cyclictest3027240-21kworker/2:223:52:332
2870517995237,14cyclictest3022812-21kworker/2:123:45:232
2870514995248,3cyclictest2955984-21kworker/1:122:14:411
2870521995148,2cyclictest2901199-21kworker/3:221:07:373
2870521995146,3cyclictest602597-1kworker/3:0H20:29:013
2870521995145,3cyclictest602597-1kworker/3:0H21:52:183
2870514995145,3cyclictest87634-1kworker/1:2H23:22:291
2870512995147,2cyclictest2894548-21kworker/0:220:20:590
2870512995147,2cyclictest2869015-21kworker/0:019:10:360
2870512995146,3cyclictest678554-1kworker/0:0H23:20:020
2870512995146,3cyclictest678554-1kworker/0:0H20:39:020
2870512995146,3cyclictest3014252-21kworker/0:023:44:070
2870512995145,4cyclictest678554-1kworker/0:0H19:54:590
2870512995145,3cyclictest678554-1kworker/0:0H21:47:180
2870521995046,3cyclictest2901199-21kworker/3:221:04:013
2870521995046,3cyclictest2886780-21kworker/3:020:07:023
2870521995046,2cyclictest3061947-21kworker/3:000:31:373
2870521995045,3cyclictest602597-1kworker/3:0H21:15:243
2870521995045,3cyclictest2901199-21kworker/3:220:50:173
2870514995046,3cyclictest87634-1kworker/1:2H00:34:481
2870514995046,3cyclictest2870300-21kworker/1:019:10:331
2870512995047,2cyclictest3039435-21kworker/0:100:28:240
2870512995047,2cyclictest2878037-21kworker/0:019:48:380
2870512995046,3cyclictest2904746-21kworker/0:120:49:080
2870521994946,2cyclictest3010881-21kworker/3:223:26:353
2870521994946,2cyclictest2877773-21kworker/3:219:46:423
2870521994943,4cyclictest602597-1kworker/3:0H21:42:493
2870521994943,3cyclictest602597-1kworker/3:0H19:35:263
2870521994943,3cyclictest602597-1kworker/3:0H19:35:263
2870517994934,14cyclictest3049480-21kworker/2:200:25:222
2870514994946,2cyclictest87634-1kworker/1:2H23:31:401
2870514994945,3cyclictest2926733-21kworker/1:022:47:071
2870514994944,3cyclictest87634-1kworker/1:2H21:12:481
2870512994944,3cyclictest678554-1kworker/0:0H22:17:050
2870512994943,4cyclictest678554-1kworker/0:0H21:25:120
2870512994941,6cyclictest678554-1kworker/0:0H22:35:000
2870521994844,3cyclictest2974236-21kworker/3:222:49:563
2870521994843,3cyclictest602597-1kworker/3:0H21:10:203
2870521994842,4cyclictest602597-1kworker/3:0H21:22:373
2870514994846,1cyclictest2887928-21kworker/1:120:57:431
2870514994845,2cyclictest3010497-21kworker/1:023:59:061
2870514994845,2cyclictest2980928-21kworker/1:123:06:361
2870514994843,3cyclictest87634-1kworker/1:2H23:38:081
2870514994843,3cyclictest2889605-21kworker/1:020:05:011
2870512994845,2cyclictest2963798-21kworker/0:122:43:360
2870512994844,3cyclictest3039435-21kworker/0:100:38:080
2870512994844,3cyclictest2886557-21kworker/0:220:05:370
2870512994843,3cyclictest2940098-21kworker/0:121:50:060
2870521994744,2cyclictest2886780-21kworker/3:020:04:113
2870521994742,3cyclictest602597-1kworker/3:0H20:40:073
2870521994742,3cyclictest602597-1kworker/3:0H20:15:033
2870514994744,2cyclictest3010497-21kworker/1:000:14:371
2870514994744,2cyclictest2926733-21kworker/1:022:08:031
2870514994744,2cyclictest2887928-21kworker/1:121:25:331
2870514994744,2cyclictest2877765-21kworker/1:119:45:071
2870514994743,3cyclictest2877765-21kworker/1:119:44:171
2870514994743,2cyclictest87634-1kworker/1:2H20:17:061
2870514994742,3cyclictest2894570-21kworker/1:020:20:541
2870514994741,3cyclictest87634-1kworker/1:2H20:52:091
287051499470,45cyclictest0-21swapper/122:19:251
2870512994743,3cyclictest2985232-21kworker/0:222:57:570
2870512994743,3cyclictest2902836-21kworker/0:020:43:360
2870512994743,2cyclictest2891240-21kworker/0:120:27:020
2870512994742,3cyclictest678554-1kworker/0:0H23:35:190
2870521994643,2cyclictest3014962-21kworker/3:123:50:303
2870521994643,2cyclictest2974236-21kworker/3:222:54:083
2870521994643,2cyclictest2901199-21kworker/3:221:00:003
2870521994639,4cyclictest602597-1kworker/3:0H23:47:313
2870514994643,2cyclictest3010497-21kworker/1:000:19:081
2870514994643,2cyclictest2980928-21kworker/1:123:00:371
2870514994643,2cyclictest2926733-21kworker/1:021:59:021
2870514994643,2cyclictest2926733-21kworker/1:021:53:251
2870514994643,2cyclictest2926733-21kworker/1:021:40:331
2870514994643,2cyclictest2887928-21kworker/1:120:46:051
2870514994643,2cyclictest2886276-21kworker/1:219:55:361
2870514994642,2cyclictest2868800-21kworker/1:219:31:021
2870514994641,3cyclictest87634-1kworker/1:2H21:47:241
2870512994642,3cyclictest3039435-21kworker/0:100:10:390
2870512994642,2cyclictest2891240-21kworker/0:120:11:110
2870521994542,2cyclictest3039907-21kworker/3:200:07:503
2870521994540,3cyclictest602597-1kworker/3:0H22:57:033
2870521994539,3cyclictest602597-1kworker/3:0H20:10:203
2870514994542,2cyclictest2980928-21kworker/1:123:17:331
2870514994542,2cyclictest2887928-21kworker/1:121:06:241
2870514994542,2cyclictest2887928-21kworker/1:120:41:111
287051499450,3cyclictest2993063-21sa123:00:011
2870512994542,2cyclictest2993005-21kworker/0:023:07:440
2870512994542,2cyclictest2904746-21kworker/0:121:32:200
2870512994542,2cyclictest2904746-21kworker/0:121:14:030
2870512994542,2cyclictest2878037-21kworker/0:019:32:050
2870512994542,2cyclictest2869015-21kworker/0:019:18:370
2870512994541,3cyclictest678554-1kworker/0:0H21:56:370
2870512994541,3cyclictest2967207-21kworker/0:222:36:230
2870512994541,2cyclictest678554-1kworker/0:0H23:55:210
2870512994541,2cyclictest2869015-21kworker/0:019:20:260
2870521994440,3cyclictest602597-1kworker/3:0H23:34:373
2870521994440,2cyclictest602597-1kworker/3:0H23:20:223
2870521994440,2cyclictest2876120-21kworker/3:119:25:343
2870514994441,2cyclictest87634-1kworker/1:2H20:10:551
2870514994441,2cyclictest2868800-21kworker/1:219:25:281
2870514994440,2cyclictest3018766-21kworker/1:223:50:191
2870512994441,2cyclictest2947901-21kworker/0:222:01:370
2870512994441,2cyclictest2878037-21kworker/0:020:01:030
2870521994340,2cyclictest2954827-21kworker/3:122:14:553
2870521994339,3cyclictest602597-1kworker/3:0H22:31:353
2870521994339,2cyclictest3014962-21kworker/3:123:39:553
2870514994339,3cyclictest87634-1kworker/1:2H00:23:071
2870514994339,2cyclictest87634-1kworker/1:2H22:50:211
2870514994337,3cyclictest3010497-21kworker/1:023:46:041
2870512994340,2cyclictest3025673-21kworker/0:223:52:390
2870512994340,2cyclictest3025673-21kworker/0:200:04:370
2870512994340,2cyclictest2985232-21kworker/0:222:53:360
2870512994340,2cyclictest2891240-21kworker/0:120:17:110
2870512994339,3cyclictest3039435-21kworker/0:100:09:370
2870512994339,2cyclictest2894548-21kworker/0:220:33:430
2870512994339,2cyclictest2878037-21kworker/0:019:44:360
2870512994338,3cyclictest678554-1kworker/0:0H22:20:190
2870521994240,1cyclictest602597-1kworker/3:0H22:24:553
2870521994237,4cyclictest602597-1kworker/3:0H23:00:533
2870521994237,4cyclictest602597-1kworker/3:0H22:40:233
2870521994237,3cyclictest602597-1kworker/3:0H21:47:373
2870521994237,3cyclictest602597-1kworker/3:0H00:39:043
2870521994236,4cyclictest602597-1kworker/3:0H21:37:213
2870514994239,2cyclictest87634-1kworker/1:2H20:34:421
2870514994239,2cyclictest2926733-21kworker/1:022:40:541
2870514994239,2cyclictest2926733-21kworker/1:021:34:371
2870514994238,3cyclictest87634-1kworker/1:2H21:21:001
2870514994238,3cyclictest2926733-21kworker/1:022:32:231
2870512994239,2cyclictest2943994-21kworker/0:022:11:100
2870512994239,2cyclictest2904844-21kworker/0:320:52:450
2870512994239,2cyclictest2904746-21kworker/0:121:23:370
2870512994239,2cyclictest2878037-21kworker/0:019:38:370
2870512994239,2cyclictest2878037-21kworker/0:019:38:360
2870521994138,2cyclictest602597-1kworker/3:0H19:51:363
2870521994137,3cyclictest2937637-21kworker/3:021:55:273
2870521994136,4cyclictest2877773-21kworker/3:219:30:263
2870514994135,3cyclictest87634-1kworker/1:2H19:35:271
2870514994135,3cyclictest87634-1kworker/1:2H19:35:271
2870512994138,2cyclictest2904746-21kworker/0:121:05:480
2870521994038,1cyclictest2995332-21kworker/3:023:14:073
2870521994037,2cyclictest602597-1kworker/3:0H23:55:223
2870521994037,2cyclictest2954827-21kworker/3:122:29:373
2870521994036,3cyclictest602597-1kworker/3:0H22:05:353
2870521994036,3cyclictest602597-1kworker/3:0H21:29:013
2870514994035,3cyclictest87634-1kworker/1:2H19:50:191
2870512994037,2cyclictest678554-1kworker/0:0H21:15:050
2870521993935,3cyclictest602597-1kworker/3:0H00:20:483
2870521993934,3cyclictest602597-1kworker/3:0H23:17:593
2870521993929,3cyclictest40-21ksoftirqd/300:10:023
2870514993936,2cyclictest0-21swapper/120:27:101
2870514993935,2cyclictest87634-1kworker/1:2H00:02:021
2870514993934,3cyclictest87634-1kworker/1:2H22:22:081
2870512993937,1cyclictest3039435-21kworker/0:100:15:380
2870512993937,1cyclictest2985232-21kworker/0:223:01:420
2870512993936,2cyclictest3025673-21kworker/0:223:46:420
2870521993835,2cyclictest602597-1kworker/3:0H23:41:033
2870514993835,2cyclictest2926733-21kworker/1:021:38:221
2870514993835,2cyclictest2901180-21kworker/1:220:37:151
2870514993834,3cyclictest87634-1kworker/1:2H00:38:381
2870512993835,2cyclictest678554-1kworker/0:0H20:55:120
2870512993834,2cyclictest678554-1kworker/0:0H23:15:280
2870521993732,3cyclictest602597-1kworker/3:0H20:35:163
2870521993730,5cyclictest602597-1kworker/3:0H00:16:363
2870514993733,2cyclictest87634-1kworker/1:2H23:27:301
2870514993732,2cyclictest87634-1kworker/1:2H19:21:581
2870514993731,4cyclictest3010497-21kworker/1:023:45:001
2870521993632,3cyclictest602597-1kworker/3:0H20:21:373
2870521993632,3cyclictest3047699-21kworker/3:100:28:293
2870521993632,2cyclictest3039907-21kworker/3:200:04:563
2870514993633,2cyclictest2926733-21kworker/1:022:02:211
2870514993631,3cyclictest87634-1kworker/1:2H00:05:271
2870512993633,2cyclictest2928391-21kworker/0:221:35:210
2870512993630,3cyclictest678554-1kworker/0:0H22:27:230
2870521993531,3cyclictest602597-1kworker/3:0H19:57:093
2870512993532,1cyclictest678554-1kworker/0:0H00:20:180
2870512993531,2cyclictest678554-1kworker/0:0H00:33:370
2870521993431,2cyclictest602597-1kworker/3:0H20:32:023
2870521993430,3cyclictest602597-1kworker/3:0H19:14:563
2870521993430,2cyclictest602597-1kworker/3:0H20:45:213
2870514993430,3cyclictest87634-1kworker/1:2H21:15:341
2870514993330,2cyclictest87634-1kworker/1:2H00:27:411
2870512993329,2cyclictest678554-1kworker/0:0H19:57:020
2870521993228,2cyclictest2974236-21kworker/3:222:35:463
287052199320,2cyclictest151rcu_preempt22:17:063
287051499321,29cyclictest0-21swapper/123:12:151
2870512993227,3cyclictest678554-1kworker/0:0H19:27:000
287052199311,4cyclictest572-21rs:main3
2870514993127,3cyclictest2969193-21kworker/1:222:29:021
2870512993128,2cyclictest678554-1kworker/0:0H23:26:370
2870521993026,3cyclictest602597-1kworker/3:0H19:44:553
287051499291,3cyclictest2890510-21irqstats20:05:211
287051799281,23cyclictest0-21swapper/219:10:002
2870521992722,3cyclictest2901199-21kworker/3:221:30:543
2870512992618,2cyclictest678554-1kworker/0:0H22:45:230
2870512992521,3cyclictest678554-1kworker/0:0H22:05:290
287051499230,2cyclictest0-21swapper/121:00:071
287052199211,16cyclictest2870618-21cut19:10:013
287051299210,14cyclictest2870509-21cyclictest19:10:000
287051499151,12cyclictest0-21swapper/119:10:001
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional