You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-07 - 05:15
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot3.osadl.org (updated Mon Jul 07, 2025 00:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2451315997744,30cyclictest2455552-21kworker/1:019:55:171
2451315997439,33cyclictest2469846-21kworker/1:120:25:121
2451315997142,28cyclictest3922255-1kworker/1:1H22:30:161
2451315997141,28cyclictest2511244-21kworker/1:022:20:161
2451315997138,31cyclictest3922255-1kworker/1:1H22:00:001
2451315997039,29cyclictest2531987-21kworker/1:223:20:171
2451315996935,32cyclictest2455552-21kworker/1:019:25:141
2451315996739,27cyclictest2481212-21kworker/1:320:45:181
2451315996738,27cyclictest2545259-21kworker/1:023:55:171
2451315996738,27cyclictest2545259-21kworker/1:023:55:171
2451315996662,2cyclictest2537724-21fschecks_count23:30:161
2451315996641,23cyclictest3922255-1kworker/1:1H23:35:131
2451315996538,26cyclictest2455552-21kworker/1:019:50:161
2451315996461,2cyclictest0-21swapper/119:33:541
2451315996438,25cyclictest2528107-21kworker/1:123:05:191
245131599640,2cyclictest0-21swapper/123:11:281
2451315996335,26cyclictest3922255-1kworker/1:1H20:02:111
245131599630,1cyclictest0-21swapper/119:22:031
2451315996260,1cyclictest0-21swapper/121:49:591
2451315996259,2cyclictest0-21swapper/120:32:231
2451315996239,22cyclictest2523884-21kworker/1:222:54:591
2451315996239,21cyclictest3922255-1kworker/1:1H21:20:001
2451315996239,20cyclictest2445784-21kworker/1:219:15:011
2451315996232,29cyclictest2551967-21kworker/1:100:23:591
2451315996229,32cyclictest3922255-1kworker/1:1H20:10:181
245131599620,1cyclictest2528769-21munin-run23:05:001
2451315996157,2cyclictest0-21swapper/100:25:261
2451315996157,2cyclictest0-21swapper/100:25:261
2451315996145,15cyclictest2501275-21kworker/1:121:42:301
2451315996143,16cyclictest3922255-1kworker/1:1H00:35:161
2451315996140,20cyclictest3922255-1kworker/1:1H22:45:061
2451315996140,20cyclictest3922255-1kworker/1:1H22:25:061
2451315996130,30cyclictest2551967-21kworker/1:100:15:151
245131599610,59cyclictest0-21swapper/122:35:151
2451315996058,1cyclictest0-21swapper/121:11:541
2451315996044,15cyclictest2469846-21kworker/1:120:17:301
2451315996043,16cyclictest2531987-21kworker/1:223:15:401
2451315996043,16cyclictest2511244-21kworker/1:022:19:001
2451315996043,16cyclictest2477915-21kworker/1:220:35:161
2451315996042,17cyclictest2469846-21kworker/1:120:20:251
2451315996038,20cyclictest3922255-1kworker/1:1H00:15:001
2451315996027,30cyclictest26250irq/16-i801_smb21:55:001
2451315995945,11cyclictest2509652-21fschecks_count22:05:141
2451315995942,16cyclictest2531987-21kworker/1:223:55:011
2451315995942,16cyclictest2489364-21kworker/1:221:10:001
2451315995941,17cyclictest2557095-21kworker/1:200:30:191
2451315995941,17cyclictest2557095-21kworker/1:200:30:191
2451315995846,10cyclictest2499059-21munin-plugin-st21:35:001
2451315995845,11cyclictest0-21swapper/120:42:201
2451315995842,15cyclictest2511244-21kworker/1:022:10:311
2451315995842,15cyclictest2489364-21kworker/1:221:35:011
2451315995840,17cyclictest2523884-21kworker/1:222:55:151
2451315995837,19cyclictest2531987-21kworker/1:223:45:151
2451315995741,15cyclictest3922255-1kworker/1:1H20:59:041
2451315995741,15cyclictest2545259-21kworker/1:000:05:231
2451315995741,15cyclictest2455552-21kworker/1:019:42:091
2451315995741,15cyclictest2455552-21kworker/1:019:35:151
2451315995728,27cyclictest3922255-1kworker/1:1H22:00:141
245131599570,1cyclictest0-21swapper/120:08:171
2451312995752,3cyclictest3103946-1kworker/0:1H23:51:290
2451316995651,3cyclictest824389-1kworker/2:0H21:35:152
2451315995640,15cyclictest2531987-21kworker/1:223:25:161
2451315995640,15cyclictest2489364-21kworker/1:221:22:251
2451315995638,17cyclictest2455552-21kworker/1:019:45:141
2451315995539,15cyclictest2519261-21kworker/1:122:40:201
2451315995539,15cyclictest2481212-21kworker/1:321:00:181
2451315995539,15cyclictest2445784-21kworker/1:219:12:391
2451315995538,16cyclictest2531987-21kworker/1:223:40:151
2451315995537,17cyclictest2545259-21kworker/1:000:00:161
2451312995550,3cyclictest2533857-21kworker/0:223:39:290
2451312995449,3cyclictest3103946-1kworker/0:1H20:20:230
2451315995349,2cyclictest0-21swapper/120:54:561
2451315995335,17cyclictest2489364-21kworker/1:221:25:061
2451312995348,3cyclictest2454926-21kworker/0:219:37:120
2451316995248,2cyclictest824389-1kworker/2:0H21:25:172
2451312995248,3cyclictest2473025-21kworker/0:120:16:530
2451312995248,3cyclictest2454926-21kworker/0:219:21:590
2451312995247,3cyclictest2522515-21kworker/0:122:46:590
2451312995247,3cyclictest2513875-21kworker/0:122:33:290
2451318995143,5cyclictest1007335-1kworker/3:2H21:17:263
2451316995146,3cyclictest824389-1kworker/2:0H20:55:152
2451316995145,3cyclictest824389-1kworker/2:0H20:00:012
2451312995148,2cyclictest2555216-21kworker/0:000:32:540
2451312995148,2cyclictest2555216-21kworker/0:000:32:530
2451312995147,3cyclictest2466599-21kworker/0:020:03:550
2451312995146,3cyclictest2540334-21kworker/0:100:07:550
2451312995146,3cyclictest2533857-21kworker/0:223:25:460
2451312995146,3cyclictest2520624-21kworker/0:023:13:590
2451312995145,4cyclictest3103946-1kworker/0:1H23:00:000
2451312995145,4cyclictest2509081-21kworker/0:322:14:290
2451318995045,3cyclictest1007335-1kworker/3:2H19:20:333
2451318995045,3cyclictest1007335-1kworker/3:2H00:19:553
2451316995045,3cyclictest2461469-21kworker/2:221:45:132
2451316995044,4cyclictest2461469-21kworker/2:221:20:192
2451312995046,3cyclictest2481147-21kworker/0:120:58:280
2451312995046,2cyclictest2540334-21kworker/0:123:59:590
2451312995046,2cyclictest2540334-21kworker/0:100:00:000
2451312995046,2cyclictest2499031-21kworker/0:121:42:000
2451312995045,3cyclictest2459801-21kworker/0:019:47:000
2451312995044,3cyclictest3103946-1kworker/0:1H22:20:160
2451316994946,2cyclictest2537156-21kworker/2:023:59:422
2451316994946,2cyclictest2537156-21kworker/2:023:59:422
2451316994944,3cyclictest824389-1kworker/2:0H23:09:302
2451316994943,3cyclictest824389-1kworker/2:0H21:50:162
2451312994946,2cyclictest2540334-21kworker/0:123:50:000
2451312994944,3cyclictest2533857-21kworker/0:223:33:280
2451312994944,3cyclictest2520624-21kworker/0:023:01:110
2451312994939,8cyclictest3103946-1kworker/0:1H00:21:280
2451318994845,2cyclictest2484389-21kworker/3:120:55:243
2451318994842,4cyclictest1007335-1kworker/3:2H23:53:233
2451316994844,3cyclictest824389-1kworker/2:0H21:13:342
2451316994843,3cyclictest824389-1kworker/2:0H22:30:162
2451316994843,3cyclictest2461469-21kworker/2:220:02:092
2451316994842,4cyclictest824389-1kworker/2:0H00:04:592
2451312994843,3cyclictest3103946-1kworker/0:1H23:20:170
2451312994843,3cyclictest3103946-1kworker/0:1H20:33:530
2451312994843,3cyclictest2555216-21kworker/0:000:35:520
2451312994843,3cyclictest2540334-21kworker/0:123:44:000
2451312994843,3cyclictest2481179-21kworker/0:320:46:290
2451316994744,2cyclictest824389-1kworker/2:0H22:45:212
2451316994743,2cyclictest824389-1kworker/2:0H20:10:412
2451316994743,2cyclictest824389-1kworker/2:0H00:16:292
2451316994741,3cyclictest824389-1kworker/2:0H20:20:152
2451312994744,2cyclictest2520624-21kworker/0:022:42:440
2451312994744,2cyclictest2499031-21kworker/0:121:52:000
2451312994742,4cyclictest2499031-21kworker/0:121:47:550
2451312994742,3cyclictest2499031-21kworker/0:121:39:530
2451318994643,2cyclictest1007335-1kworker/3:2H20:52:513
2451318994643,2cyclictest1007335-1kworker/3:2H20:15:283
2451318994641,3cyclictest1007335-1kworker/3:2H21:30:003
2451316994642,3cyclictest2522322-21kworker/2:223:10:122
2451316994642,3cyclictest2455003-21kworker/2:119:25:282
2451316994641,3cyclictest824389-1kworker/2:0H22:20:122
2451312994642,3cyclictest3103946-1kworker/0:1H20:41:280
2451312994642,3cyclictest2520624-21kworker/0:023:17:440
2451312994641,3cyclictest3103946-1kworker/0:1H00:10:250
2451318994542,2cyclictest1007335-1kworker/3:2H23:06:293
2451318994542,2cyclictest1007335-1kworker/3:2H20:22:463
2451318994542,2cyclictest1007335-1kworker/3:2H20:11:293
2451318994540,3cyclictest1007335-1kworker/3:2H23:05:003
2451318994539,4cyclictest1007335-1kworker/3:2H21:45:013
2451316994541,3cyclictest824389-1kworker/2:0H20:39:322
2451316994540,3cyclictest824389-1kworker/2:0H22:05:172
2451316994540,3cyclictest2505828-21kworker/2:122:10:352
2451312994541,3cyclictest2489305-21kworker/0:021:04:000
2451312994540,3cyclictest2520624-21kworker/0:022:38:010
2451318994441,2cyclictest1007335-1kworker/3:2H20:37:503
2451318994440,3cyclictest1007335-1kworker/3:2H19:55:183
2451316994441,2cyclictest475969-21kworker/2:219:19:282
2451316994441,2cyclictest2522322-21kworker/2:223:02:292
2451316994440,3cyclictest2537156-21kworker/2:000:25:242
2451316994440,3cyclictest2537156-21kworker/2:000:25:232
2451316994439,3cyclictest824389-1kworker/2:0H22:40:152
2451316994439,3cyclictest824389-1kworker/2:0H19:20:172
2451312994439,3cyclictest3103946-1kworker/0:1H19:28:530
2451312994437,4cyclictest3103946-1kworker/0:1H20:05:220
2451318994340,2cyclictest1007335-1kworker/3:2H20:42:253
2451318994338,4cyclictest1007335-1kworker/3:2H19:39:553
2451318994338,3cyclictest1007335-1kworker/3:2H22:00:003
2451318994337,3cyclictest1007335-1kworker/3:2H23:25:153
2451318994337,3cyclictest1007335-1kworker/3:2H22:52:403
2451316994339,3cyclictest824389-1kworker/2:0H22:18:592
2451316994338,3cyclictest824389-1kworker/2:0H00:20:162
2451316994338,3cyclictest2461469-21kworker/2:219:40:592
2451312994339,3cyclictest2454926-21kworker/0:219:31:080
2451312994339,2cyclictest2496386-21kworker/0:221:30:060
2451318994239,2cyclictest2503904-21kworker/3:121:54:293
2451318994238,3cyclictest2515778-21kworker/3:122:35:233
2451318994237,3cyclictest1007335-1kworker/3:2H22:25:293
2451318994237,3cyclictest1007335-1kworker/3:2H21:10:173
2451318994237,3cyclictest1007335-1kworker/3:2H21:06:453
2451318994237,3cyclictest1007335-1kworker/3:2H21:00:183
2451318994237,3cyclictest1007335-1kworker/3:2H20:47:273
2451318994236,4cyclictest2551964-21kworker/3:100:14:553
2451316994239,2cyclictest2461469-21kworker/2:220:06:302
2451316994238,2cyclictest824389-1kworker/2:0H21:07:232
2451316994237,3cyclictest2505828-21kworker/2:122:39:292
2451312994238,2cyclictest2555216-21kworker/0:000:29:410
2451312994238,2cyclictest2555216-21kworker/0:000:29:410
2451312994237,3cyclictest3103946-1kworker/0:1H23:05:090
2451318994137,3cyclictest1007335-1kworker/3:2H23:10:293
2451318994137,3cyclictest1007335-1kworker/3:2H22:45:273
2451318994136,3cyclictest1007335-1kworker/3:2H23:20:063
2451318994135,4cyclictest1007335-1kworker/3:2H23:40:163
2451318994135,3cyclictest1007335-1kworker/3:2H19:15:163
2451316994137,3cyclictest824389-1kworker/2:0H00:13:302
2451316994137,2cyclictest824389-1kworker/2:0H19:30:162
2451316994137,2cyclictest2505828-21kworker/2:121:57:002
2451316994137,2cyclictest2461469-21kworker/2:220:50:292
2451316994136,3cyclictest824389-1kworker/2:0H00:39:052
2451312994138,2cyclictest2496386-21kworker/0:221:25:290
2451312994136,3cyclictest2477907-21kworker/0:020:30:010
2451318994036,3cyclictest1007335-1kworker/3:2H23:45:403
2451318994035,3cyclictest1007335-1kworker/3:2H22:10:133
2451318994035,3cyclictest1007335-1kworker/3:2H19:47:283
2451318994035,3cyclictest1007335-1kworker/3:2H19:10:173
2451316994037,2cyclictest824389-1kworker/2:0H23:15:452
2451316994036,2cyclictest824389-1kworker/2:0H19:52:282
2451316994035,3cyclictest824389-1kworker/2:0H23:35:322
2451316994035,2cyclictest824389-1kworker/2:0H20:42:192
2451318993934,3cyclictest1007335-1kworker/3:2H00:40:003
2451318993932,4cyclictest1007335-1kworker/3:2H23:37:513
2451316993935,2cyclictest824389-1kworker/2:0H23:27:492
2451312993936,2cyclictest3103946-1kworker/0:1H00:00:300
2451318993833,3cyclictest1007335-1kworker/3:2H22:05:143
2451318993833,3cyclictest1007335-1kworker/3:2H21:30:153
2451318993833,3cyclictest1007335-1kworker/3:2H00:05:293
2451316993835,2cyclictest824389-1kworker/2:0H22:52:282
2451316993835,2cyclictest2461469-21kworker/2:220:27:092
2451312993835,2cyclictest2466599-21kworker/0:020:00:000
2451312993834,3cyclictest3103946-1kworker/0:1H21:17:060
2451316993733,2cyclictest824389-1kworker/2:0H21:15:172
2451312993734,2cyclictest3103946-1kworker/0:1H21:59:290
2451318993632,3cyclictest1007335-1kworker/3:2H21:35:043
2451318993631,3cyclictest2537112-21kworker/3:223:32:543
2451316993633,2cyclictest824389-1kworker/2:0H20:32:452
2451316993632,3cyclictest824389-1kworker/2:0H19:10:292
2451316993632,2cyclictest2537156-21kworker/2:023:40:142
2451312993633,2cyclictest3103946-1kworker/0:1H22:18:540
2451312993633,2cyclictest3103946-1kworker/0:1H19:40:520
2451318993530,3cyclictest1007335-1kworker/3:2H23:56:293
2451318993530,3cyclictest1007335-1kworker/3:2H23:56:293
2451318993530,3cyclictest1007335-1kworker/3:2H22:02:313
2451316993530,3cyclictest824389-1kworker/2:0H20:45:172
2451318993430,3cyclictest1007335-1kworker/3:2H22:55:363
2451318993430,2cyclictest1007335-1kworker/3:2H22:15:043
2451318993429,3cyclictest1007335-1kworker/3:2H20:30:043
2451316993431,2cyclictest2537156-21kworker/2:023:46:172
2451316993431,2cyclictest2461469-21kworker/2:219:47:452
2451312993432,1cyclictest2513875-21kworker/0:122:27:350
2451312993429,3cyclictest3103946-1kworker/0:1H19:12:020
2451318993328,3cyclictest1007335-1kworker/3:2H22:44:553
2451318993328,3cyclictest1007335-1kworker/3:2H19:50:143
2451316993330,2cyclictest2533923-21kworker/2:123:22:002
2451316993330,2cyclictest2505828-21kworker/2:122:29:002
2451316993329,3cyclictest2461469-21kworker/2:221:32:262
2451318993228,3cyclictest1007335-1kworker/3:2H00:29:293
2451318993228,3cyclictest1007335-1kworker/3:2H00:29:293
2451316993229,2cyclictest2537156-21kworker/2:023:30:242
2451316993228,3cyclictest2505828-21kworker/2:122:03:052
2451316993228,2cyclictest2455003-21kworker/2:119:35:142
2451312993228,2cyclictest3103946-1kworker/0:1H20:50:150
2451312993227,3cyclictest3103946-1kworker/0:1H21:05:160
2451318993127,3cyclictest1007335-1kworker/3:2H20:27:223
245131899310,9cyclictest2517920-21cstates22:30:153
2451316993128,2cyclictest2537156-21kworker/2:023:52:012
2451316993128,2cyclictest2461469-21kworker/2:221:40:242
2451312993128,2cyclictest3103946-1kworker/0:1H19:17:270
2451312993128,2cyclictest2520624-21kworker/0:022:50:190
2451312993125,4cyclictest3103946-1kworker/0:1H21:12:250
2451318993026,2cyclictest1007335-1kworker/3:2H19:33:283
2451318993025,3cyclictest1007335-1kworker/3:2H22:20:153
2451316993027,2cyclictest2522322-21kworker/2:222:56:012
2451312993027,2cyclictest2466599-21kworker/0:020:12:130
245131299300,3cyclictest151rcu_preempt00:15:120
2451316992926,2cyclictest2537156-21kworker/2:000:33:592
2451316992926,2cyclictest2537156-21kworker/2:000:33:592
2451316992925,3cyclictest824389-1kworker/2:0H00:10:002
2451315992916,5cyclictest2451339-21wc19:10:011
2451312992825,2cyclictest3103946-1kworker/0:1H20:36:290
2451318992724,2cyclictest2503904-21kworker/3:121:45:403
2451318992724,2cyclictest1007335-1kworker/3:2H00:20:463
2451318992722,3cyclictest1007335-1kworker/3:2H19:40:183
2451312992724,2cyclictest3103946-1kworker/0:1H22:00:280
2451318992623,2cyclictest1007335-1kworker/3:2H21:22:323
245131899261,2cyclictest0-21swapper/300:34:053
245131899261,2cyclictest0-21swapper/300:34:043
245131899260,7cyclictest0-21swapper/323:19:093
245131899250,3cyclictest0-21swapper/320:05:273
2451312992420,2cyclictest3103946-1kworker/0:1H22:07:330
2451312992420,2cyclictest3103946-1kworker/0:1H21:20:200
2451318992320,2cyclictest2547071-21kworker/3:000:03:413
2451316992320,2cyclictest2461469-21kworker/2:221:03:302
245131899220,3cyclictest2469822-21munin-run20:04:593
245131299215,14cyclictest2466038-21ntpq19:50:180
245131899190,5cyclictest2457123-21df19:25:143
245131699192,14cyclictest2473285-21/usr/sbin/munin20:15:152
245131899171,4cyclictest40-21ksoftirqd/319:10:003
245131699124,5cyclictest2451371-21date19:10:012
24513129994,3cyclictest2451336-21latency_hist19:10:010
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional