You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-06 - 06:35
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot3.osadl.org (updated Sun Jul 06, 2025 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
225150799640,63cyclictest0-21swapper/122:50:001
225150799622,3cyclictest2267239-21kworker/1:120:00:191
225150799621,1cyclictest0-21swapper/120:54:271
2251507996042,17cyclictest2263507-21kworker/1:219:50:001
2251507996042,17cyclictest2252962-21kworker/1:119:15:011
2251507996042,16cyclictest3011280-1kworker/1:2H19:55:151
2251507995941,17cyclictest2275368-21kworker/1:220:35:151
2251507995941,16cyclictest2339710-21kworker/1:023:35:161
2251507995940,18cyclictest2252962-21kworker/1:119:25:171
2251507995843,14cyclictest2339710-21kworker/1:023:45:181
2251507995842,15cyclictest2337541-21kworker/1:223:34:581
2251507995842,15cyclictest2315965-21kworker/1:322:35:161
2251507995842,15cyclictest2263507-21kworker/1:219:49:551
2251507995839,17cyclictest2299690-21kworker/1:021:35:151
225150799581,2cyclictest0-21swapper/119:40:161
225150799580,57cyclictest0-21swapper/121:10:171
2251507995741,15cyclictest2291361-1kworker/1:0H00:33:131
2251507995741,15cyclictest2275368-21kworker/1:220:40:171
2251507995740,16cyclictest2311034-21kworker/1:022:15:161
2251507995739,17cyclictest3011280-1kworker/1:2H20:59:591
2251507995739,16cyclictest2267239-21kworker/1:120:05:151
2251507995737,19cyclictest2291361-1kworker/1:0H00:10:001
2251507995734,21cyclictest3011280-1kworker/1:2H20:30:001
2251507995641,14cyclictest2326505-21kworker/1:222:55:151
2251507995641,14cyclictest2302933-21kworker/1:121:55:161
2251507995641,14cyclictest2287050-21kworker/1:221:20:161
2251507995641,14cyclictest2252962-21kworker/1:119:34:561
2251507995640,15cyclictest2326505-21kworker/1:223:10:151
2251507995640,15cyclictest2311034-21kworker/1:022:21:321
2251507995640,15cyclictest2308402-21kworker/1:222:02:521
2251507995640,15cyclictest2267239-21kworker/1:120:15:151
2251507995638,16cyclictest2291361-1kworker/1:0H00:23:081
2251509995550,3cyclictest824389-1kworker/2:0H00:28:322
2251507995539,15cyclictest3011280-1kworker/1:2H20:23:271
2251507995539,15cyclictest2339710-21kworker/1:023:55:051
2251507995539,15cyclictest2287050-21kworker/1:221:15:171
2251507995539,15cyclictest2283225-21kworker/1:120:46:021
2251507995539,15cyclictest2267239-21kworker/1:120:14:551
2251507995537,17cyclictest2339710-21kworker/1:000:00:191
2251507995537,17cyclictest2252962-21kworker/1:119:40:001
2251507995537,17cyclictest2252962-21kworker/1:119:20:151
2251507995536,18cyclictest2291361-1kworker/1:0H23:50:031
2251507995532,21cyclictest2291361-1kworker/1:0H00:40:001
2251510995449,3cyclictest2279975-21kworker/3:220:35:383
2251510995438,14cyclictest1007335-1kworker/3:2H20:50:333
2251509995450,2cyclictest1007383-21kworker/2:019:24:272
2251509995449,3cyclictest2347712-21kworker/2:200:03:372
2251507995439,14cyclictest3011280-1kworker/1:2H19:10:121
2251507995439,14cyclictest2339710-21kworker/1:023:40:191
2251507995439,14cyclictest2302933-21kworker/1:121:52:571
2251507995438,15cyclictest2349970-21kworker/1:100:10:051
2251507995438,15cyclictest2324025-21kworker/1:122:53:301
2251507995438,15cyclictest2287050-21kworker/1:221:31:281
2251507995438,15cyclictest2287050-21kworker/1:221:05:161
2251507995437,16cyclictest2326505-21kworker/1:223:00:171
2251507995436,17cyclictest2287050-21kworker/1:221:05:001
225150799540,53cyclictest0-21swapper/123:15:151
225150799540,52cyclictest1-21systemd21:45:001
2251503995446,6cyclictest3103946-1kworker/0:1H20:18:260
2251507995338,14cyclictest2334064-21kworker/1:323:20:171
2251507995337,15cyclictest2315965-21kworker/1:322:25:231
2251507995336,16cyclictest2311034-21kworker/1:022:10:171
2251507995333,19cyclictest2287050-21kworker/1:221:25:161
225150799530,4cyclictest623-21rs:main1
225150799530,4cyclictest623-21rs:main1
225150799530,2cyclictest0-21swapper/121:46:571
2251503995347,4cyclictest2298060-21kworker/0:221:38:570
2251503995347,4cyclictest2284899-21kworker/0:321:18:520
2251503995346,3cyclictest3103946-1kworker/0:1H22:27:560
2251510995249,2cyclictest2345844-21kworker/3:200:01:033
2251510995249,2cyclictest2327497-21kworker/3:023:08:283
2251510995249,2cyclictest2319399-21kworker/3:222:40:243
2251510995249,2cyclictest2297821-21kworker/3:221:33:523
2251510995249,2cyclictest2284831-21kworker/3:021:22:273
2251510995249,2cyclictest2284831-21kworker/3:021:12:503
2251510995248,2cyclictest2284831-21kworker/3:021:26:203
2251507995237,14cyclictest2308402-21kworker/1:222:07:531
2251507995235,16cyclictest2275368-21kworker/1:220:35:011
2251510995147,2cyclictest2284831-21kworker/3:020:49:273
2251507995148,2cyclictest0-21swapper/122:40:241
2251507995136,14cyclictest2349970-21kworker/1:100:15:021
2251507995135,15cyclictest2349970-21kworker/1:100:25:141
2251507995134,16cyclictest2336475-21kworker/1:123:25:151
2251510995047,2cyclictest2325628-21kworker/3:122:52:263
2251510995047,2cyclictest2315918-21kworker/3:022:34:523
2251510995047,2cyclictest2315918-21kworker/3:022:34:523
2251510995046,3cyclictest2261872-21kworker/3:119:48:523
2251510995045,3cyclictest2333993-21kworker/3:223:20:543
2251503995046,2cyclictest2354228-21kworker/0:100:36:380
2251503995045,3cyclictest2354228-21kworker/0:100:20:050
2251503995045,3cyclictest2342357-21kworker/0:123:49:260
2251503995045,3cyclictest2324019-21kworker/0:122:53:270
2251510994945,2cyclictest2273475-21kworker/3:020:16:523
2251509994945,3cyclictest824389-1kworker/2:0H19:54:592
2251503994945,3cyclictest2330747-21kworker/0:223:15:280
2251503994944,3cyclictest2348006-21kworker/0:000:07:140
2251503994944,3cyclictest2343980-21kworker/0:223:59:460
2251503994944,3cyclictest2324019-21kworker/0:122:56:330
2251503994944,3cyclictest2270236-21kworker/0:220:11:100
2251503994944,3cyclictest2268599-21kworker/0:020:03:280
2251503994944,3cyclictest2260256-21kworker/0:119:46:320
2251503994941,4cyclictest3103946-1kworker/0:1H22:20:150
2251510994845,2cyclictest2350998-21kworker/3:100:08:283
2251510994845,2cyclictest2337501-21kworker/3:023:52:263
2251510994845,2cyclictest2327497-21kworker/3:023:10:073
2251510994845,2cyclictest2297821-21kworker/3:221:38:273
2251510994845,2cyclictest2268600-21kworker/3:120:08:273
2251510994841,5cyclictest1007335-1kworker/3:2H23:30:053
2251507994832,15cyclictest2291361-1kworker/1:0H23:05:061
2251503994845,2cyclictest2284899-21kworker/0:321:04:280
2251503994844,2cyclictest2262461-21kworker/0:019:42:570
2251503994843,4cyclictest2307854-21kworker/0:322:07:570
2251503994843,3cyclictest2343980-21kworker/0:200:02:270
2251510994743,3cyclictest2350998-21kworker/3:100:38:143
2251510994743,3cyclictest2345844-21kworker/3:223:55:563
2251510994741,4cyclictest2350998-21kworker/3:100:15:393
2251510994741,4cyclictest2261872-21kworker/3:119:43:523
2251509994744,2cyclictest824389-1kworker/2:0H22:48:052
2251509994743,3cyclictest824389-1kworker/2:0H23:53:572
2251509994742,3cyclictest824389-1kworker/2:0H23:38:212
2251509994742,3cyclictest824389-1kworker/2:0H20:30:172
2251503994743,3cyclictest2307854-21kworker/0:322:14:520
2251503994743,3cyclictest2270236-21kworker/0:220:42:570
2251503994743,2cyclictest2298060-21kworker/0:221:40:060
2251510994641,3cyclictest1007335-1kworker/3:2H22:45:193
2251510994640,4cyclictest2307782-21kworker/3:122:17:423
2251509994643,2cyclictest824389-1kworker/2:0H21:55:242
2251509994643,2cyclictest824389-1kworker/2:0H19:25:262
2251509994640,4cyclictest824389-1kworker/2:0H23:27:272
2251509994640,4cyclictest824389-1kworker/2:0H22:07:592
2251503994642,2cyclictest2252975-21kworker/0:019:26:190
2251503994642,2cyclictest2252975-21kworker/0:019:21:270
2251503994641,3cyclictest2354228-21kworker/0:100:30:280
2251503994641,2cyclictest3103946-1kworker/0:1H19:35:140
2251510994541,3cyclictest2315918-21kworker/3:022:35:573
2251510994541,3cyclictest2284831-21kworker/3:021:17:373
2251510994541,3cyclictest2268600-21kworker/3:120:02:573
2251510994541,3cyclictest2258638-21kworker/3:219:29:273
2251510994540,3cyclictest2350998-21kworker/3:100:29:553
2251510994540,3cyclictest2337501-21kworker/3:023:40:523
2251510994540,3cyclictest1007335-1kworker/3:2H21:04:553
2251510994540,3cyclictest1007335-1kworker/3:2H19:55:173
2251510994539,4cyclictest2258638-21kworker/3:219:36:173
2251510994539,3cyclictest2284831-21kworker/3:020:56:583
2251510994539,3cyclictest1007335-1kworker/3:2H22:00:163
2251510994536,5cyclictest1007335-1kworker/3:2H20:27:353
2251509994542,2cyclictest824389-1kworker/2:0H20:44:272
2251509994542,2cyclictest824389-1kworker/2:0H20:18:052
2251509994542,2cyclictest1007383-21kworker/2:021:27:462
2251509994542,1cyclictest824389-1kworker/2:0H20:30:012
2251509994540,3cyclictest824389-1kworker/2:0H21:12:442
2251509994540,3cyclictest2325696-21kworker/2:123:45:232
2251509994539,4cyclictest824389-1kworker/2:0H23:15:432
2251509994539,4cyclictest1007383-21kworker/2:020:50:142
2251509994539,3cyclictest824389-1kworker/2:0H21:15:142
2251509994538,4cyclictest824389-1kworker/2:0H20:10:172
2251503994542,2cyclictest2335873-21kworker/0:223:33:570
2251503994542,2cyclictest2249852-21kworker/0:219:10:520
2251503994541,2cyclictest3103946-1kworker/0:1H22:30:160
2251503994541,2cyclictest3103946-1kworker/0:1H22:30:160
2251503994540,3cyclictest2332362-21kworker/0:123:22:260
2251510994441,2cyclictest2350998-21kworker/3:100:20:283
2251510994441,2cyclictest2297821-21kworker/3:221:57:573
2251510994440,2cyclictest2315918-21kworker/3:022:25:593
2251510994439,3cyclictest2327497-21kworker/3:023:17:363
2251510994439,3cyclictest2307782-21kworker/3:122:05:453
2251510994439,3cyclictest1007335-1kworker/3:2H21:45:383
2251509994441,2cyclictest824389-1kworker/2:0H21:42:572
2251509994441,2cyclictest824389-1kworker/2:0H19:43:572
2251509994440,2cyclictest2325696-21kworker/2:123:58:272
2251509994439,3cyclictest824389-1kworker/2:0H23:07:272
2251509994439,3cyclictest824389-1kworker/2:0H20:45:152
2251509994439,3cyclictest824389-1kworker/2:0H20:22:442
2251509994439,3cyclictest824389-1kworker/2:0H20:01:102
2251509994439,3cyclictest824389-1kworker/2:0H00:16:572
2251509994439,3cyclictest1007383-21kworker/2:021:48:572
2251509994438,4cyclictest824389-1kworker/2:0H23:41:572
2251509994438,4cyclictest824389-1kworker/2:0H22:25:002
2251510994338,3cyclictest1007335-1kworker/3:2H19:24:543
2251510994337,3cyclictest1007335-1kworker/3:2H23:00:013
2251509994340,2cyclictest824389-1kworker/2:0H21:09:272
2251509994339,3cyclictest2325696-21kworker/2:123:33:272
2251509994338,3cyclictest824389-1kworker/2:0H21:36:262
2251509994338,3cyclictest824389-1kworker/2:0H21:03:582
2251509994337,3cyclictest824389-1kworker/2:0H00:38:082
2251503994340,1cyclictest3103946-1kworker/0:1H21:47:490
2251503994339,2cyclictest3103946-1kworker/0:1H20:35:150
2251503994338,3cyclictest3103946-1kworker/0:1H23:51:090
2251503994338,3cyclictest2270236-21kworker/0:220:08:500
2251510994236,3cyclictest1007335-1kworker/3:2H00:10:163
2251509994236,3cyclictest824389-1kworker/2:0H22:00:172
2251509994235,5cyclictest824389-1kworker/2:0H22:53:352
2251509994234,5cyclictest824389-1kworker/2:0H00:33:452
2251503994240,1cyclictest3103946-1kworker/0:1H21:30:140
2251503994238,2cyclictest2330747-21kworker/0:223:13:400
2251503994238,2cyclictest2284899-21kworker/0:321:08:360
2251503994237,3cyclictest3103946-1kworker/0:1H21:26:260
2251503994236,4cyclictest3103946-1kworker/0:1H21:57:510
2251503994233,2cyclictest3103946-1kworker/0:1H20:25:210
2251510994134,3cyclictest1007335-1kworker/3:2H21:52:493
2251509994138,2cyclictest1007383-21kworker/2:022:10:172
2251509994136,4cyclictest824389-1kworker/2:0H20:37:272
2251509994136,3cyclictest824389-1kworker/2:0H19:11:022
2251509994134,4cyclictest824389-1kworker/2:0H20:55:152
2251503994137,2cyclictest3103946-1kworker/0:1H22:04:260
2251510994036,2cyclictest1007335-1kworker/3:2H00:34:553
2251509994037,2cyclictest2325696-21kworker/2:123:13:272
2251509994036,3cyclictest1007383-21kworker/2:022:30:362
2251509994036,3cyclictest1007383-21kworker/2:022:30:362
2251509994036,2cyclictest824389-1kworker/2:0H00:05:382
2251509994035,4cyclictest824389-1kworker/2:0H22:18:292
2251509994035,3cyclictest2347712-21kworker/2:200:11:512
2251503994037,2cyclictest2327771-21kworker/0:023:07:030
2251503994037,2cyclictest2314271-21kworker/0:122:36:520
2251503994036,2cyclictest2284899-21kworker/0:321:11:580
2251510993934,3cyclictest1007335-1kworker/3:2H23:00:173
2251509993936,2cyclictest1007383-21kworker/2:019:45:062
2251509993935,3cyclictest1007383-21kworker/2:022:37:272
2251509993933,3cyclictest824389-1kworker/2:0H23:05:012
2251503993936,2cyclictest3103946-1kworker/0:1H20:55:330
2251503993936,2cyclictest2292935-21kworker/0:121:20:330
2251503993935,3cyclictest2348006-21kworker/0:000:15:220
2251510993833,3cyclictest1007335-1kworker/3:2H19:10:123
2251503993836,1cyclictest3103946-1kworker/0:1H22:45:010
2251503993835,2cyclictest3103946-1kworker/0:1H19:54:520
2251503993835,2cyclictest2324019-21kworker/0:123:04:070
2251510993733,2cyclictest1007335-1kworker/3:2H20:30:153
2251509993734,2cyclictest2325696-21kworker/2:122:58:062
2251509993733,2cyclictest1007383-21kworker/2:020:05:062
2251509993733,2cyclictest1007383-21kworker/2:019:58:582
2251503993732,3cyclictest3103946-1kworker/0:1H21:50:140
2251510993633,2cyclictest2337501-21kworker/3:023:37:343
2251509993633,2cyclictest1007383-21kworker/2:022:25:062
2251503993632,2cyclictest2252975-21kworker/0:019:30:070
2251503993630,3cyclictest3103946-1kworker/0:1H22:45:170
2251503993622,2cyclictest3103946-1kworker/0:1H20:50:150
2251510993532,2cyclictest2307782-21kworker/3:122:20:333
2251509993532,2cyclictest2325696-21kworker/2:123:23:262
2251509993532,2cyclictest1007383-21kworker/2:019:15:132
2251503993531,3cyclictest3103946-1kworker/0:1H20:47:540
2251510993432,1cyclictest2273475-21kworker/3:020:12:573
2251510993431,2cyclictest2279975-21kworker/3:220:40:373
2251509993431,2cyclictest1007383-21kworker/2:019:36:262
2251503993431,2cyclictest3103946-1kworker/0:1H19:55:380
2251503993430,2cyclictest3103946-1kworker/0:1H00:15:000
2251509993330,2cyclictest1007383-21kworker/2:021:52:272
2251503993330,2cyclictest3103946-1kworker/0:1H23:35:280
2251510993229,2cyclictest2258638-21kworker/3:219:32:383
2251509993228,2cyclictest1007383-21kworker/2:021:24:542
2251509993225,4cyclictest824389-1kworker/2:0H22:42:582
2251507993225,4cyclictest0-21swapper/119:10:011
2251510993128,2cyclictest1007335-1kworker/3:2H20:24:583
2251510993127,2cyclictest1007335-1kworker/3:2H23:45:163
2251509993126,3cyclictest2347712-21kworker/2:200:20:152
2251503993127,2cyclictest53250irq/160-enp0s2900:30:000
2251503993127,2cyclictest3103946-1kworker/0:1H20:20:140
2251510993026,3cyclictest1007335-1kworker/3:2H19:19:563
225150399302,21cyclictest2253788-21apt-get19:15:120
2251503992926,2cyclictest3103946-1kworker/0:1H20:30:410
2251510992825,2cyclictest1007335-1kworker/3:2H21:41:263
225150999281,16cyclictest2258910-21apt-get19:30:152
2251510992722,3cyclictest1007335-1kworker/3:2H19:55:003
2251509992723,3cyclictest33-21ksoftirqd/221:30:212
2251503992724,2cyclictest3103946-1kworker/0:1H23:40:300
2251503992723,3cyclictest3103946-1kworker/0:1H23:26:270
2251510992520,3cyclictest2337157-21sensors23:25:203
225150399250,20cyclictest2312932-21apt-get22:15:140
225151099200,2cyclictest151rcu_preempt21:05:153
2251510991916,2cyclictest2307782-21kworker/3:122:10:323
225151099150,3cyclictest0-21swapper/319:10:013
225150999150,2cyclictest0-21swapper/219:10:012
225150399150,12cyclictest0-21swapper/019:10:010
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional