You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-20 - 09:15
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot3.osadl.org (updated Wed May 20, 2026 00:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
263712997241,30cyclictest267156-21kworker/1:219:40:131
26371299650,64cyclictest0-21swapper/121:22:121
26371299650,3cyclictest359293-21kworker/1:022:15:151
263712996440,22cyclictest881507-1kworker/1:0H21:40:001
263712996140,20cyclictest422640-21kworker/1:023:25:141
263712995944,14cyclictest456920-21kworker/1:000:10:151
263712995941,17cyclictest267156-21kworker/1:219:35:151
263712995940,18cyclictest881507-1kworker/1:0H20:05:011
263712995940,17cyclictest262340-21kworker/1:019:15:141
263713995845,11cyclictest3402818-1kworker/2:1H20:45:152
263712995842,15cyclictest881507-1kworker/1:0H21:10:141
263712995842,15cyclictest276436-21kworker/1:119:50:171
263712995840,16cyclictest881507-1kworker/1:0H22:55:131
263712995836,20cyclictest292551-21kworker/1:320:45:131
263713995750,5cyclictest351610-21kworker/2:222:06:322
263713995742,13cyclictest3402818-1kworker/2:1H21:20:012
263712995741,15cyclictest432506-21kworker/1:023:40:131
263712995741,15cyclictest283224-21kworker/1:020:25:141
263712995740,16cyclictest375642-21kworker/1:222:35:161
263712995740,16cyclictest349521-21kworker/1:122:05:011
263712995736,20cyclictest295206-21kworker/1:120:55:141
26371299571,3cyclictest283224-21kworker/1:020:15:011
263711995753,2cyclictest442265-21kworker/0:100:00:010
263713995648,5cyclictest3402818-1kworker/2:1H23:40:312
263712995641,14cyclictest488310-21kworker/1:000:35:141
263712995641,14cyclictest488310-21kworker/1:000:31:241
263712995641,14cyclictest432506-21kworker/1:023:35:141
263712995641,14cyclictest410122-21kworker/1:123:20:151
263712995641,14cyclictest394337-21kworker/1:023:10:001
263712995641,14cyclictest389521-21kworker/1:322:45:131
263712995640,15cyclictest295206-21kworker/1:121:00:451
263712995639,16cyclictest461988-21kworker/1:100:06:131
263712995638,17cyclictest276436-21kworker/1:119:55:131
26371299562,3cyclictest0-21swapper/120:18:071
263721995551,3cyclictest3655225-1kworker/3:2H22:09:393
263712995540,14cyclictest442255-21kworker/1:223:45:151
263712995540,14cyclictest262340-21kworker/1:019:10:181
263712995539,15cyclictest410122-21kworker/1:123:15:161
263712995539,15cyclictest394337-21kworker/1:023:05:131
263712995537,17cyclictest276436-21kworker/1:120:05:141
26371299550,54cyclictest604-21rs:main1
26371299550,2cyclictest0-21swapper/121:18:321
263711995550,3cyclictest1167012-1kworker/0:0H20:25:390
263721995450,2cyclictest247498-21kworker/3:221:02:033
263721995449,3cyclictest3655225-1kworker/3:2H22:41:463
263721995449,3cyclictest3655225-1kworker/3:2H19:59:283
263713995448,4cyclictest3402818-1kworker/2:1H21:20:262
263712995439,14cyclictest349521-21kworker/1:122:05:161
263712995439,14cyclictest288777-21kworker/1:220:40:141
263712995439,14cyclictest274895-21kworker/1:019:45:141
263712995439,14cyclictest267156-21kworker/1:219:30:001
263712995438,15cyclictest881507-1kworker/1:0H20:50:311
263712995438,15cyclictest456920-21kworker/1:000:01:181
263712995438,15cyclictest394337-21kworker/1:022:50:171
263712995438,15cyclictest328470-21kworker/1:121:40:161
263712995438,15cyclictest288777-21kworker/1:220:30:151
263712995437,16cyclictest472061-21kworker/1:100:21:401
263712995436,17cyclictest375642-21kworker/1:222:40:141
263711995449,3cyclictest1167012-1kworker/0:0H23:04:100
263721995349,3cyclictest247498-21kworker/3:220:33:403
263721995348,3cyclictest3655225-1kworker/3:2H23:00:153
263712995349,2cyclictest26350irq/16-i801_smb00:00:011
263712995348,3cyclictest0-21swapper/122:31:021
263712995338,14cyclictest427123-21kworker/1:223:30:141
263712995338,14cyclictest394337-21kworker/1:023:00:011
263712995338,14cyclictest369088-21kworker/1:122:26:031
263712995338,14cyclictest333370-21kworker/1:221:45:171
263712995338,14cyclictest313846-21kworker/1:221:27:361
263712995338,14cyclictest283224-21kworker/1:020:22:021
263712995337,15cyclictest318668-21kworker/1:121:30:591
263712995336,16cyclictest299587-21kworker/1:221:10:001
26371299530,51cyclictest338869-21grep21:50:141
263711995349,3cyclictest259129-21kworker/0:019:11:320
263711995338,13cyclictest1167012-1kworker/0:0H22:31:030
263721995248,3cyclictest247498-21kworker/3:219:50:423
263713995245,4cyclictest3402818-1kworker/2:1H22:20:422
263713995244,6cyclictest3402818-1kworker/2:1H21:14:592
263713995244,5cyclictest3402818-1kworker/2:1H19:40:312
263713995242,6cyclictest3402818-1kworker/2:1H00:40:012
263712995249,2cyclictest0-21swapper/121:59:081
263712995248,2cyclictest366525-21fschecks_count22:20:141
263712995237,14cyclictest467178-21kworker/1:200:15:371
263712995237,14cyclictest442255-21kworker/1:223:50:261
263712995237,14cyclictest288777-21kworker/1:220:35:001
263712995236,15cyclictest263833-21kworker/1:119:20:131
263711995246,4cyclictest1167012-1kworker/0:0H23:41:120
263721995145,4cyclictest3655225-1kworker/3:2H19:20:283
263713995145,4cyclictest3402818-1kworker/2:1H22:30:202
263713995143,5cyclictest3402818-1kworker/2:1H21:45:172
263712995135,15cyclictest482443-21kworker/1:300:26:131
263712995135,15cyclictest267156-21kworker/1:219:25:291
263711995147,2cyclictest271794-21kworker/0:219:51:140
263711995146,3cyclictest1167012-1kworker/0:0H19:30:290
263721995046,3cyclictest247498-21kworker/3:219:16:333
263721995044,4cyclictest3655225-1kworker/3:2H22:01:283
263721995044,4cyclictest3655225-1kworker/3:2H00:36:133
263721995044,4cyclictest3655225-1kworker/3:2H00:20:443
263713995044,4cyclictest3402818-1kworker/2:1H20:15:012
263711995047,2cyclictest391356-21kworker/0:122:46:460
263711995047,2cyclictest268715-21kworker/0:019:43:080
263711995045,3cyclictest296744-21kworker/0:020:56:230
263711995045,3cyclictest1167012-1kworker/0:0H23:20:220
263711995045,3cyclictest1167012-1kworker/0:0H22:17:060
263711995044,4cyclictest271794-21kworker/0:219:38:080
263721994945,3cyclictest3655225-1kworker/3:2H20:59:273
263721994944,3cyclictest3655225-1kworker/3:2H21:35:133
263713994943,3cyclictest3402818-1kworker/2:1H19:55:012
263713994941,5cyclictest3402818-1kworker/2:1H20:50:142
263711994947,1cyclictest358773-21kworker/0:222:50:420
263711994945,3cyclictest303729-21kworker/0:021:55:010
263711994945,2cyclictest290321-21kworker/0:020:36:020
263711994944,3cyclictest1167012-1kworker/0:0H00:17:060
263721994844,2cyclictest247498-21kworker/3:219:41:063
263721994843,3cyclictest481718-21kworker/3:100:30:063
263711994846,1cyclictest303729-21kworker/0:021:59:070
263711994845,2cyclictest299584-21kworker/0:221:05:420
263711994845,2cyclictest271794-21kworker/0:220:40:270
263711994844,3cyclictest271794-21kworker/0:219:49:020
263711994844,3cyclictest1167012-1kworker/0:0H21:41:240
263721994744,2cyclictest3655225-1kworker/3:2H23:42:173
263721994743,3cyclictest247498-21kworker/3:220:05:423
263721994741,4cyclictest3655225-1kworker/3:2H21:33:083
263713994742,3cyclictest438226-21kworker/2:123:40:002
263713994741,3cyclictest392233-21kworker/2:122:53:452
263711994745,1cyclictest1167012-1kworker/0:0H21:15:150
263711994744,2cyclictest465820-21kworker/0:200:07:120
263711994744,2cyclictest442265-21kworker/0:123:53:390
263711994744,2cyclictest1167012-1kworker/0:0H21:04:590
263711994743,2cyclictest284139-21kworker/0:020:16:340
263711994743,2cyclictest1167012-1kworker/0:0H00:01:550
263721994643,2cyclictest3655225-1kworker/3:2H22:50:113
263721994642,3cyclictest3655225-1kworker/3:2H23:14:553
263721994641,3cyclictest3655225-1kworker/3:2H21:09:023
263711994641,3cyclictest1167012-1kworker/0:0H20:45:130
263711994640,4cyclictest1167012-1kworker/0:0H00:25:310
263721994542,2cyclictest416737-21kworker/3:000:09:553
263721994541,3cyclictest3655225-1kworker/3:2H23:49:133
263721994541,3cyclictest3655225-1kworker/3:2H00:00:083
263721994540,3cyclictest3655225-1kworker/3:2H19:30:133
263721994539,4cyclictest3655225-1kworker/3:2H21:25:003
263713994539,3cyclictest3402818-1kworker/2:1H22:55:312
263713994539,3cyclictest3402818-1kworker/2:1H20:20:132
263711994541,3cyclictest1167012-1kworker/0:0H21:20:320
263711994541,2cyclictest1167012-1kworker/0:0H22:10:130
263721994440,3cyclictest3655225-1kworker/3:2H23:51:433
263721994440,3cyclictest3655225-1kworker/3:2H23:27:103
263713994439,3cyclictest3402818-1kworker/2:1H23:06:132
263713994431,9cyclictest3402818-1kworker/2:1H00:05:192
263711994441,2cyclictest423716-21kworker/0:223:31:480
263711994441,2cyclictest268715-21kworker/0:019:28:330
263711994441,2cyclictest1167012-1kworker/0:0H20:00:270
263711994440,3cyclictest358773-21kworker/0:222:25:310
263711994439,4cyclictest351592-21kworker/0:122:07:140
263711994439,3cyclictest1167012-1kworker/0:0H00:38:180
263711994438,4cyclictest1167012-1kworker/0:0H21:26:390
263721994341,1cyclictest416737-21kworker/3:023:55:113
263721994340,2cyclictest247498-21kworker/3:222:14:563
263721994339,3cyclictest3655225-1kworker/3:2H23:21:163
263721994339,3cyclictest3655225-1kworker/3:2H20:48:283
263721994338,3cyclictest416737-21kworker/3:000:15:123
263721994337,4cyclictest3655225-1kworker/3:2H23:36:133
263713994339,2cyclictest3402818-1kworker/2:1H20:42:032
263713994338,3cyclictest3402818-1kworker/2:1H21:40:152
263711994340,2cyclictest1167012-1kworker/0:0H21:46:020
263711994338,3cyclictest1167012-1kworker/0:0H23:17:360
263711994338,3cyclictest1167012-1kworker/0:0H22:36:040
263711994338,3cyclictest1167012-1kworker/0:0H00:33:370
263711994337,4cyclictest1167012-1kworker/0:0H23:25:100
263721994239,2cyclictest416737-21kworker/3:000:10:253
263721994239,2cyclictest3655225-1kworker/3:2H21:57:133
263721994239,2cyclictest3655225-1kworker/3:2H20:28:283
263721994238,2cyclictest3655225-1kworker/3:2H23:05:133
263721994238,2cyclictest247498-21kworker/3:219:35:153
263721994236,4cyclictest3655225-1kworker/3:2H22:59:593
263721994236,3cyclictest3655225-1kworker/3:2H20:35:133
263713994237,3cyclictest3402818-1kworker/2:1H23:31:192
263713994236,3cyclictest3402818-1kworker/2:1H21:50:132
263711994239,2cyclictest291863-21kworker/0:120:51:380
263711994239,2cyclictest271794-21kworker/0:220:33:030
263711994237,3cyclictest358773-21kworker/0:222:20:370
263711994237,3cyclictest1167012-1kworker/0:0H20:06:020
263721994138,2cyclictest416737-21kworker/3:023:35:013
263721994138,2cyclictest3655225-1kworker/3:2H20:00:223
263721994138,2cyclictest3655225-1kworker/3:2H19:49:553
263721994138,2cyclictest247498-21kworker/3:222:39:353
263713994138,2cyclictest447877-21kworker/2:223:59:132
263713994137,2cyclictest3402818-1kworker/2:1H23:20:012
263713994136,3cyclictest3402818-1kworker/2:1H19:17:142
263711994138,2cyclictest1167012-1kworker/0:0H19:19:020
263711994136,4cyclictest1167012-1kworker/0:0H00:13:130
263721994037,2cyclictest3655225-1kworker/3:2H22:29:553
263721994036,2cyclictest416737-21kworker/3:023:15:063
263721994036,2cyclictest3655225-1kworker/3:2H20:50:143
263721994035,3cyclictest247498-21kworker/3:221:42:343
263713994034,3cyclictest3402818-1kworker/2:1H23:50:132
263721993936,2cyclictest3655225-1kworker/3:2H21:29:073
263721993935,3cyclictest3655225-1kworker/3:2H22:23:083
263713993936,2cyclictest263549-21kworker/2:119:25:292
263721993835,2cyclictest481718-21kworker/3:100:25:063
263721993835,2cyclictest247498-21kworker/3:222:15:223
263721993834,2cyclictest3655225-1kworker/3:2H21:11:023
263721993833,4cyclictest3655225-1kworker/3:2H22:33:103
263721993833,3cyclictest3655225-1kworker/3:2H21:18:073
263713993835,2cyclictest290315-21kworker/2:120:35:212
263713993834,3cyclictest3402818-1kworker/2:1H21:25:102
263713993834,3cyclictest290315-21kworker/2:121:00:202
26371399380,35cyclictest463011-21apt-key00:05:002
263711993835,2cyclictest1167012-1kworker/0:0H22:42:100
263711993834,3cyclictest1167012-1kworker/0:0H23:11:260
263721993734,2cyclictest247498-21kworker/3:221:54:553
263721993732,3cyclictest3655225-1kworker/3:2H21:47:133
263713993732,3cyclictest3402818-1kworker/2:1H22:02:382
26371399371,33cyclictest489201-21ssh00:32:142
26371399370,35cyclictest0-21swapper/200:29:422
26371399370,34cyclictest428692-21ssh23:26:582
263711993734,2cyclictest442265-21kworker/0:123:45:420
263711993733,3cyclictest1167012-1kworker/0:0H21:14:340
263711993732,3cyclictest262223-21kworker/0:319:20:100
263721993633,2cyclictest3655225-1kworker/3:2H20:17:153
263721993633,1cyclictest3655225-1kworker/3:2H20:10:163
263721993632,3cyclictest247498-21kworker/3:222:48:103
263713993631,3cyclictest3402818-1kworker/2:1H23:45:152
263713993631,3cyclictest3402818-1kworker/2:1H22:11:052
263713993631,3cyclictest3402818-1kworker/2:1H20:15:142
263713993631,3cyclictest3402818-1kworker/2:1H00:10:152
263713993630,3cyclictest3402818-1kworker/2:1H22:15:152
26371399361,32cyclictest0-21swapper/222:35:172
26371399360,33cyclictest0-21swapper/221:30:132
26371399360,15cyclictest372437-21ssh22:25:582
263711993631,3cyclictest1167012-1kworker/0:0H00:21:220
263711993630,3cyclictest1167012-1kworker/0:0H21:30:530
263713993530,3cyclictest3402818-1kworker/2:1H23:20:152
26371399350,33cyclictest0-21swapper/222:41:132
26371399350,32cyclictest474592-21ssh00:16:032
26371399350,32cyclictest0-21swapper/220:25:202
26371399350,31cyclictest479361-21ssh00:21:122
26371399350,15cyclictest0-21swapper/223:12:292
26371399350,14cyclictest270906-21/usr/sbin/munin19:30:122
263721993431,2cyclictest3655225-1kworker/3:2H20:22:013
263713993430,2cyclictest3402818-1kworker/2:1H21:37:082
26371399341,31cyclictest0-21swapper/219:35:202
26371399341,12cyclictest0-21swapper/222:45:292
26371399340,32cyclictest0-21swapper/221:57:162
263711993431,2cyclictest396277-21kworker/0:022:55:460
263711993431,2cyclictest303729-21kworker/0:022:01:330
263711993430,3cyclictest1167012-1kworker/0:0H19:58:270
263721993330,2cyclictest247498-21kworker/3:219:29:543
263721993329,2cyclictest3655225-1kworker/3:2H20:40:143
26371399330,12cyclictest405188-21ssh23:01:382
263711993328,3cyclictest318403-21kworker/0:221:35:130
263713993229,2cyclictest290315-21kworker/2:120:58:332
26371399320,29cyclictest276344-21grep19:45:202
26371299312,26cyclictest26-21ksoftirqd/119:10:001
263711993127,3cyclictest1167012-1kworker/0:0H23:35:060
26371399301,26cyclictest263867-21grep19:10:162
26371399291,9cyclictest0-21swapper/220:05:122
26371399290,26cyclictest0-21swapper/220:30:142
26371399290,16cyclictest268930-21cut19:25:012
263711992926,2cyclictest1167012-1kworker/0:0H20:20:260
263721992825,2cyclictest3655225-1kworker/3:2H19:10:263
26371199281,3cyclictest408819-21/usr/sbin/munin23:05:170
26371399270,19cyclictest0-21swapper/220:02:192
263711992724,2cyclictest1167012-1kworker/0:0H20:11:070
26371399250,23cyclictest279036-21cat19:55:162
26371399250,22cyclictest300405-21/usr/sbin/munin21:05:142
26371399221,18cyclictest263718-21latency_hist19:09:592
26371199192,3cyclictest151rcu_preempt19:10:000
26372199180,5cyclictest263782-21sed19:10:003
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional