You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-29 - 14:31
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot3.osadl.org (updated Sat Nov 29, 2025 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3689121996759,5cyclictest2841348-1kworker/0:1H23:55:010
3689126996662,2cyclictest0-21swapper/120:37:091
3689126996539,21cyclictest3720407-21kworker/1:221:10:131
3689126996359,2cyclictest0-21swapper/121:40:051
3689126996333,24cyclictest1447917-1kworker/1:1H19:45:001
3689126996243,18cyclictest3766099-21kworker/1:123:10:191
3689126996142,18cyclictest3746116-21kworker/1:022:15:161
3689126996139,21cyclictest3755803-21kworker/1:322:50:141
3689126996043,16cyclictest3734748-21kworker/1:221:35:001
3689126996043,16cyclictest3734748-21kworker/1:221:32:261
3689126996043,16cyclictest3704715-21kworker/1:019:55:441
3689126996039,19cyclictest3779337-21kworker/1:200:05:141
3689126995957,1cyclictest0-21swapper/122:48:081
3689126995955,2cyclictest0-21swapper/122:23:081
3689126995943,15cyclictest3720407-21kworker/1:220:52:271
3689126995943,15cyclictest3702550-21kworker/1:220:10:151
3689126995942,16cyclictest3779337-21kworker/1:200:25:001
3689126995942,16cyclictest3672360-21kworker/1:319:25:151
3689126995942,15cyclictest3746116-21kworker/1:022:12:281
3689126995939,19cyclictest3702550-21kworker/1:219:50:491
3689126995938,19cyclictest3734748-21kworker/1:221:25:141
3689126995853,3cyclictest0-21swapper/120:26:311
3689126995842,15cyclictest3779337-21kworker/1:223:45:051
3689126995842,15cyclictest3766099-21kworker/1:123:07:381
3689126995842,15cyclictest3763872-21kworker/1:023:00:151
3689126995842,15cyclictest3742312-21kworker/1:321:50:171
3689126995842,15cyclictest3730893-21kworker/1:021:22:221
3689126995842,15cyclictest3714465-21kworker/1:120:40:141
3689126995842,15cyclictest3714465-21kworker/1:120:30:001
3689126995842,15cyclictest3702550-21kworker/1:220:05:091
3689126995841,16cyclictest1447917-1kworker/1:1H22:36:231
3689126995838,19cyclictest3734748-21kworker/1:221:45:141
3689126995755,1cyclictest0-21swapper/120:17:211
3689126995754,2cyclictest0-21swapper/119:32:101
3689126995752,3cyclictest0-21swapper/100:13:241
3689126995741,15cyclictest3779337-21kworker/1:223:55:161
3689126995741,15cyclictest3770598-21kworker/1:023:15:141
3689126995741,15cyclictest3770598-21kworker/1:023:15:131
3689126995741,15cyclictest3755803-21kworker/1:322:32:291
3689126995741,15cyclictest3730893-21kworker/1:021:15:011
3689126995741,15cyclictest3712500-21kworker/1:020:20:161
3689126995741,15cyclictest3672360-21kworker/1:319:23:141
3689126995741,15cyclictest3672360-21kworker/1:319:15:011
3689126995741,15cyclictest1447917-1kworker/1:1H19:36:591
3689126995740,16cyclictest3770598-21kworker/1:023:20:401
3689126995740,16cyclictest3702550-21kworker/1:220:00:131
3689126995740,15cyclictest1447917-1kworker/1:1H20:55:151
3689126995737,18cyclictest3746116-21kworker/1:022:05:141
3689126995653,2cyclictest0-21swapper/100:35:051
3689126995640,15cyclictest3779337-21kworker/1:223:53:301
3689126995640,15cyclictest3770598-21kworker/1:023:25:161
3689126995640,15cyclictest3770598-21kworker/1:023:25:151
3689126995640,15cyclictest3755803-21kworker/1:322:55:171
3689126995640,15cyclictest3755803-21kworker/1:322:40:011
3689126995640,15cyclictest3742312-21kworker/1:321:57:291
3689126995640,15cyclictest3742312-21kworker/1:321:57:281
3689126995640,15cyclictest3720407-21kworker/1:221:07:291
3689126995640,15cyclictest1447917-1kworker/1:1H22:25:431
3689126995639,16cyclictest3779337-21kworker/1:200:22:391
3689126995639,16cyclictest3770598-21kworker/1:023:35:241
3689126995639,16cyclictest3746116-21kworker/1:022:00:141
3689126995635,20cyclictest3770598-21kworker/1:023:35:001
3689126995539,15cyclictest3779337-21kworker/1:223:42:441
3689126995539,15cyclictest3672360-21kworker/1:319:13:141
3689126995538,16cyclictest3720407-21kworker/1:221:04:561
3689126995538,16cyclictest3720407-21kworker/1:220:45:211
3689126995535,18cyclictest1447917-1kworker/1:1H19:45:151
3689126995532,21cyclictest3779337-21kworker/1:200:30:151
3689126995438,15cyclictest3779337-21kworker/1:200:00:021
3689126995435,18cyclictest3779337-21kworker/1:200:15:151
3689121995451,2cyclictest3762255-21kworker/0:123:14:290
3689121995448,3cyclictest2841348-1kworker/0:1H20:02:040
3689121995349,2cyclictest3768728-21kworker/0:223:08:570
3689129995247,3cyclictest2483543-1kworker/2:1H23:23:212
3689129995247,3cyclictest2483543-1kworker/2:1H20:07:092
3689134995147,2cyclictest3688926-21kworker/3:019:14:443
3689129995146,3cyclictest2483543-1kworker/2:1H21:06:182
3689121995147,2cyclictest3684534-21kworker/0:019:26:020
3689134995047,2cyclictest3763854-21kworker/3:223:59:323
3689134995047,2cyclictest3739012-21kworker/3:021:55:573
3689134995047,2cyclictest3739012-21kworker/3:021:55:573
3689134995046,3cyclictest3692745-21kworker/3:119:30:263
3689134995046,2cyclictest3763854-21kworker/3:223:47:443
3689134995046,2cyclictest1395319-1kworker/3:0H23:50:143
3689134995045,3cyclictest1395319-1kworker/3:0H00:12:393
3689129995045,3cyclictest3700933-21kworker/2:120:30:212
3689121995047,2cyclictest3758996-21kworker/0:022:40:280
3689121995047,2cyclictest3745504-21kworker/0:222:14:290
3689121995046,2cyclictest3743886-21kworker/0:021:57:230
3689121995046,2cyclictest3743886-21kworker/0:021:57:230
3689121995046,2cyclictest3737381-21kworker/0:121:46:280
3689134994946,2cyclictest3712220-21kworker/3:120:43:563
3689134994946,1cyclictest3788722-21kworker/3:100:07:393
3689121994945,2cyclictest3684534-21kworker/0:020:15:000
3689121994944,3cyclictest3762255-21kworker/0:123:02:220
3689121994944,3cyclictest2841348-1kworker/0:1H22:25:000
3689134994844,3cyclictest3712220-21kworker/3:120:52:193
3689134994844,2cyclictest3712220-21kworker/3:121:15:073
3689134994843,3cyclictest1395319-1kworker/3:0H21:29:543
3689129994845,2cyclictest2483543-1kworker/2:1H21:27:592
3689129994845,2cyclictest2483543-1kworker/2:1H21:00:322
3689129994845,1cyclictest2483543-1kworker/2:1H20:55:152
3689129994844,3cyclictest2483543-1kworker/2:1H23:19:592
3689129994844,3cyclictest2483543-1kworker/2:1H23:19:582
3689129994844,2cyclictest2483543-1kworker/2:1H20:00:132
3689129994843,3cyclictest2483543-1kworker/2:1H00:07:082
3689121994845,2cyclictest3758996-21kworker/0:022:45:220
3689121994845,2cyclictest3737381-21kworker/0:121:50:220
3689121994845,2cyclictest3684534-21kworker/0:019:34:200
3689121994844,2cyclictest3768728-21kworker/0:223:18:100
3689121994844,2cyclictest3768728-21kworker/0:223:18:100
3689121994844,2cyclictest3684534-21kworker/0:019:47:430
3689121994843,4cyclictest2841348-1kworker/0:1H20:45:230
3689121994843,3cyclictest2841348-1kworker/0:1H21:25:140
3689121994841,4cyclictest2841348-1kworker/0:1H19:20:130
3689134994744,2cyclictest3712220-21kworker/3:121:09:023
3689134994743,2cyclictest3793603-21kworker/3:000:23:293
3689134994743,2cyclictest1395319-1kworker/3:0H22:10:263
3689129994744,2cyclictest2483543-1kworker/2:1H21:39:222
3689129994742,3cyclictest2483543-1kworker/2:1H22:44:592
3689121994744,2cyclictest3775477-21kworker/0:123:34:280
3689121994744,2cyclictest3718717-21kworker/0:120:38:200
3689121994743,2cyclictest3762255-21kworker/0:122:58:050
3689121994743,2cyclictest3755747-21kworker/0:022:30:070
3689121994743,2cyclictest2841348-1kworker/0:1H20:20:240
3689121994742,3cyclictest3778713-21kworker/0:223:55:430
3689121994742,3cyclictest3684534-21kworker/0:019:50:270
3689121994742,3cyclictest2841348-1kworker/0:1H21:35:180
3689121994738,7cyclictest2841348-1kworker/0:1H00:32:090
3689134994643,2cyclictest3712220-21kworker/3:120:31:263
3689134994643,2cyclictest1395319-1kworker/3:0H19:29:553
3689134994641,3cyclictest1395319-1kworker/3:0H22:45:333
3689134994641,3cyclictest1395319-1kworker/3:0H19:15:433
3689129994643,1cyclictest2483543-1kworker/2:1H22:00:142
3689129994641,3cyclictest2483543-1kworker/2:1H23:04:232
3689129994641,3cyclictest2483543-1kworker/2:1H21:45:142
3689129994641,3cyclictest2483543-1kworker/2:1H00:23:332
3689121994643,2cyclictest3718717-21kworker/0:121:06:130
3689121994643,2cyclictest3684534-21kworker/0:019:39:080
3689121994642,2cyclictest3718717-21kworker/0:120:56:570
3689121994641,3cyclictest3798105-21kworker/0:100:39:190
3689134994542,2cyclictest3712220-21kworker/3:120:48:273
3689134994542,2cyclictest3702508-21kworker/3:220:01:453
3689134994540,3cyclictest1395319-1kworker/3:0H22:35:203
3689134994539,3cyclictest1395319-1kworker/3:0H21:50:153
3689129994540,3cyclictest2483543-1kworker/2:1H20:35:322
3689129994540,3cyclictest2483543-1kworker/2:1H19:16:552
3689121994542,2cyclictest3778713-21kworker/0:223:46:590
3689121994542,2cyclictest3745504-21kworker/0:222:05:440
3689121994542,2cyclictest3718717-21kworker/0:121:10:560
3689121994542,2cyclictest3684534-21kworker/0:020:30:350
3689121994541,2cyclictest3778713-21kworker/0:200:23:450
3689121994540,3cyclictest3725518-21kworker/0:221:17:570
3689121994540,3cyclictest2841348-1kworker/0:1H20:50:150
3689134994442,1cyclictest3793603-21kworker/3:000:28:403
3689134994442,1cyclictest3763854-21kworker/3:223:44:233
3689134994442,1cyclictest3739012-21kworker/3:022:00:593
3689134994442,1cyclictest3712220-21kworker/3:120:39:213
3689134994441,2cyclictest3734152-21kworker/3:221:30:443
3689134994441,2cyclictest3712220-21kworker/3:120:56:093
3689134994440,2cyclictest3699247-21kworker/3:019:39:433
3689134994440,2cyclictest1395319-1kworker/3:0H23:07:393
3689134994438,2cyclictest3692745-21kworker/3:119:20:383
3689129994439,3cyclictest2483543-1kworker/2:1H19:47:092
3689129994438,3cyclictest2483543-1kworker/2:1H00:30:152
3689121994442,1cyclictest3684534-21kworker/0:020:26:080
3689121994441,2cyclictest3778713-21kworker/0:200:04:340
3689121994440,2cyclictest3684534-21kworker/0:019:55:070
3689121994438,4cyclictest2841348-1kworker/0:1H22:00:130
3689121994438,4cyclictest2841348-1kworker/0:1H21:20:220
368913499430,2cyclictest0-21swapper/319:46:433
3689129994339,3cyclictest2483543-1kworker/2:1H19:25:062
3689129994338,3cyclictest2483543-1kworker/2:1H20:22:062
3689129994338,3cyclictest2483543-1kworker/2:1H19:36:432
3689121994340,2cyclictest3745504-21kworker/0:222:37:230
3689121994340,2cyclictest3745504-21kworker/0:222:27:260
3689121994339,2cyclictest2841348-1kworker/0:1H23:27:420
3689121994339,2cyclictest2841348-1kworker/0:1H23:27:410
3689121994338,3cyclictest2841348-1kworker/0:1H23:20:230
3689134994240,1cyclictest3763854-21kworker/3:223:32:533
3689134994239,2cyclictest3702508-21kworker/3:220:16:493
3689134994239,2cyclictest1395319-1kworker/3:0H22:29:553
3689134994238,2cyclictest3763854-21kworker/3:223:00:243
3689129994238,3cyclictest2483543-1kworker/2:1H22:09:572
3689129994236,3cyclictest2483543-1kworker/2:1H23:45:162
3689121994239,2cyclictest3778713-21kworker/0:200:10:270
3689121994239,2cyclictest3778713-21kworker/0:200:08:350
3689121994239,2cyclictest3775477-21kworker/0:123:35:280
3689121994239,2cyclictest3737381-21kworker/0:121:43:570
3689121994238,3cyclictest3770859-21kworker/0:023:40:050
3689121994238,2cyclictest3732501-21kworker/0:021:30:290
3689134994138,2cyclictest3712220-21kworker/3:120:22:223
3689134994138,2cyclictest3699247-21kworker/3:019:40:203
3689134994137,2cyclictest3734152-21kworker/3:221:24:223
3689134994137,2cyclictest1395319-1kworker/3:0H23:25:173
3689134994137,2cyclictest1395319-1kworker/3:0H23:25:173
3689134994137,2cyclictest1395319-1kworker/3:0H00:35:283
3689134994136,3cyclictest3760680-21kworker/3:122:51:303
3689134994136,3cyclictest3758997-21kworker/3:022:41:293
3689134994136,3cyclictest1395319-1kworker/3:0H23:19:563
3689134994136,3cyclictest1395319-1kworker/3:0H23:19:553
3689134994136,3cyclictest1395319-1kworker/3:0H20:25:153
3689129994138,2cyclictest2483543-1kworker/2:1H22:20:582
3689129994137,3cyclictest2483543-1kworker/2:1H23:28:582
3689129994137,3cyclictest2483543-1kworker/2:1H23:28:572
3689129994137,3cyclictest2483543-1kworker/2:1H22:19:232
3689129994137,3cyclictest2483543-1kworker/2:1H21:15:272
3689129994137,2cyclictest2483543-1kworker/2:1H21:55:132
3689129994137,2cyclictest2483543-1kworker/2:1H21:55:132
3689121994139,1cyclictest3718717-21kworker/0:120:40:060
3689121994138,2cyclictest3778713-21kworker/0:200:25:300
3689121994138,2cyclictest3778713-21kworker/0:200:15:240
3689121994138,2cyclictest2841348-1kworker/0:1H20:05:260
3689121994137,2cyclictest2841348-1kworker/0:1H19:10:160
3689121994136,3cyclictest3745504-21kworker/0:222:15:060
3689134994037,2cyclictest1395319-1kworker/3:0H23:25:003
3689134994036,2cyclictest3763854-21kworker/3:200:16:343
3689134994036,2cyclictest1395319-1kworker/3:0H20:05:203
3689134994035,3cyclictest1395319-1kworker/3:0H22:08:573
3689129994037,2cyclictest2483543-1kworker/2:1H23:07:232
3689129994037,2cyclictest2483543-1kworker/2:1H22:55:292
3689129994037,2cyclictest2483543-1kworker/2:1H19:30:092
3689129994037,1cyclictest2483543-1kworker/2:1H23:55:132
3689129994035,3cyclictest2483543-1kworker/2:1H22:10:052
3689121994038,1cyclictest3718717-21kworker/0:121:02:570
3689134993936,2cyclictest3739012-21kworker/3:021:48:073
3689134993936,2cyclictest3712220-21kworker/3:121:14:273
3689134993935,2cyclictest3753887-21kworker/3:222:32:373
3689134993933,3cyclictest1395319-1kworker/3:0H20:10:153
3689129993936,2cyclictest2483543-1kworker/2:1H23:36:582
3689129993936,2cyclictest2483543-1kworker/2:1H21:12:282
3689129993936,2cyclictest2483543-1kworker/2:1H20:45:162
3689129993936,2cyclictest2483543-1kworker/2:1H20:42:432
3689129993934,3cyclictest2483543-1kworker/2:1H00:10:142
3689129993933,3cyclictest2483543-1kworker/2:1H21:30:142
3689129993933,3cyclictest2483543-1kworker/2:1H20:12:052
3689134993835,2cyclictest3763854-21kworker/3:200:02:153
3689129993835,2cyclictest2483543-1kworker/2:1H23:33:572
3689129993833,4cyclictest2483543-1kworker/2:1H19:42:092
3689129993833,3cyclictest2483543-1kworker/2:1H00:28:242
3689121993835,2cyclictest3758996-21kworker/0:022:52:400
3689121993833,3cyclictest2841348-1kworker/0:1H19:40:390
3689134993734,2cyclictest1395319-1kworker/3:0H22:20:333
3689134993734,2cyclictest1395319-1kworker/3:0H21:00:573
3689129993734,2cyclictest3700933-21kworker/2:119:50:152
3689129993734,2cyclictest2483543-1kworker/2:1H21:44:582
3689129993733,3cyclictest2483543-1kworker/2:1H22:50:162
3689129993732,3cyclictest2483543-1kworker/2:1H21:50:152
3689134993633,2cyclictest3763854-21kworker/3:223:12:573
3689134993632,2cyclictest3702508-21kworker/3:219:57:023
3689134993629,4cyclictest1395319-1kworker/3:0H00:30:153
3689129993633,2cyclictest2483543-1kworker/2:1H22:25:592
3689129993632,3cyclictest2483543-1kworker/2:1H00:19:092
3689129993631,3cyclictest2483543-1kworker/2:1H23:53:242
3689129993630,4cyclictest2483543-1kworker/2:1H00:00:302
3689134993530,3cyclictest1395319-1kworker/3:0H22:15:283
3689134993530,3cyclictest1395319-1kworker/3:0H21:44:563
3689129993531,3cyclictest2483543-1kworker/2:1H22:45:062
3689129993531,3cyclictest2483543-1kworker/2:1H20:15:052
3689129993531,3cyclictest2483543-1kworker/2:1H00:35:542
3689129993530,3cyclictest2483543-1kworker/2:1H22:31:242
3689129993425,5cyclictest2483543-1kworker/2:1H20:27:082
368912999340,3cyclictest0-21swapper/219:20:212
3689121993431,2cyclictest3684534-21kworker/0:019:15:240
3689129993327,4cyclictest2483543-1kworker/2:1H22:38:022
3689129993228,3cyclictest2483543-1kworker/2:1H23:40:332
3689129993226,3cyclictest2483543-1kworker/2:1H20:52:122
3689134993128,2cyclictest3763854-21kworker/3:223:35:233
3689121993125,4cyclictest2841348-1kworker/0:1H20:20:000
3689134993028,1cyclictest3734152-21kworker/3:221:38:023
3689129993023,4cyclictest2483543-1kworker/2:1H19:10:162
3689129992925,3cyclictest2483543-1kworker/2:1H21:22:292
3689129992824,3cyclictest2483543-1kworker/2:1H23:10:572
3689134992519,4cyclictest1395319-1kworker/3:0H19:55:013
368912999258,13cyclictest621-21in:imuxsock20:00:002
3689126992319,2cyclictest3689172-21latency_hist19:10:001
368913499220,17cyclictest3764117-21/usr/sbin/munin22:55:173
368912199163,9cyclictest3689115-21cyclictest19:10:000
368912999149,3cyclictest33-21ksoftirqd/219:10:002
368913499104,3cyclictest0-21swapper/319:10:003
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional