You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-10 - 15:27

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot6s.osadl.org (updated Sun May 10, 2026 12:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
248599690,5rtkit-daemon34-21rcuc/304:50:540
520199654,54cyclictest0-21swapper/307:51:453
519999646,50cyclictest1419-21runrttasks09:00:482
519999646,50cyclictest1419-21runrttasks09:00:482
5194996435,13cyclictest0-21swapper/010:05:410
519999635,49cyclictest0-21swapper/209:25:512
519899634,42cyclictest0-21swapper/107:52:211
5198996325,23cyclictest31957-21switchtime06:51:071
519499629,47cyclictest58-21kswapd010:16:550
519999618,13cyclictest0-21swapper/209:50:502
519999615,48cyclictest0-21swapper/208:25:332
519999615,48cyclictest0-21swapper/208:25:332
519999615,13cyclictest0-21swapper/209:11:022
5198996143,11cyclictest7766-21needreboot06:01:041
5198996143,10cyclictest790-21gltestperf07:40:551
519999604,13cyclictest0-21swapper/208:36:172
5194996033,13cyclictest0-21swapper/008:06:040
271592602,18sleep30-21swapper/309:06:453
520199595,47cyclictest26765-21munin-node07:30:583
520199594,11cyclictest0-21swapper/308:11:113
5201995933,14cyclictest0-21swapper/310:11:523
519999593,11cyclictest5584-21tr10:10:552
519899594,36cyclictest0-21swapper/107:14:211
5194995932,13cyclictest0-21swapper/008:55:010
24172592,33sleep20-21swapper/207:42:592
101072593,49sleep20-21swapper/208:41:082
99092583,48sleep010022-21grep09:30:450
78932583,48sleep10-21swapper/104:55:541
520199584,10cyclictest1376-21munin-node08:30:433
520199583,50cyclictest0-21swapper/310:04:113
5194995829,12cyclictest0-21swapper/008:43:190
5194995821,24cyclictest9848-21http_loadtime06:06:000
255282584,12sleep20-21swapper/205:31:062
255282584,12sleep20-21swapper/205:31:062
115002584,47sleep30-21swapper/307:09:423
519999575,43cyclictest11121-21ssh07:55:542
519899575,43cyclictest0-21swapper/107:22:241
5198995717,21cyclictest0-21swapper/104:51:291
5198995714,21cyclictest4293-21tail05:55:531
519499574,26cyclictest0-21swapper/007:01:110
519499574,26cyclictest0-21swapper/007:01:110
519499574,25cyclictest0-21swapper/009:35:490
5194995731,12cyclictest0-21swapper/009:54:180
5194995731,12cyclictest0-21swapper/008:20:580
5194995731,12cyclictest0-21swapper/008:20:580
5194995731,12cyclictest0-21swapper/008:01:010
5194995729,13cyclictest0-21swapper/007:05:580
251052572,9sleep20-21swapper/209:05:442
520199563,9cyclictest24910-21munin-node09:51:013
519999567,13cyclictest20111-21grep09:45:432
519999564,12cyclictest0-21swapper/208:50:502
519999563,12cyclictest0-21swapper/207:45:562
519899563,24cyclictest697-21latency_hist10:05:301
5198995623,27cyclictest0-21swapper/105:16:051
5198995618,31cyclictest6681-21latency_hist07:50:361
519499564,37cyclictest0-21swapper/007:11:060
5194995634,10cyclictest0-21swapper/009:45:460
5194995634,10cyclictest0-21swapper/007:40:480
5194995630,12cyclictest0-21swapper/009:15:370
5194995629,13cyclictest0-21swapper/009:04:220
5194995629,13cyclictest0-21swapper/009:04:220
5194995629,12cyclictest0-21swapper/008:17:290
39402563,47sleep10-21swapper/106:57:431
39402563,47sleep10-21swapper/106:57:431
210052563,11sleep00-21swapper/007:22:090
156372563,10sleep30-21swapper/309:38:383
5201995514,14cyclictest0-21swapper/309:13:003
5201995510,38cyclictest0-21swapper/306:50:373
519999557,9cyclictest26-21rcuc/207:30:362
519999554,12cyclictest0-21swapper/207:00:342
519999554,12cyclictest0-21swapper/207:00:342
519999554,11cyclictest0-21swapper/209:36:242
519899558,42cyclictest0-21swapper/109:15:561
519899558,13cyclictest0-21swapper/109:02:041
519899558,13cyclictest0-21swapper/109:02:041
519899555,31cyclictest0-21swapper/107:30:351
519899555,14cyclictest0-21swapper/109:55:461
519899555,12cyclictest9379-21fschecks_time07:05:551
519899554,35cyclictest0-21swapper/109:31:141
519899554,13cyclictest0-21swapper/109:22:051
5198995513,23cyclictest0-21swapper/108:50:461
5198995511,25cyclictest0-21swapper/108:10:301
5194995536,7cyclictest11641-21kworker/0:209:07:370
519499553,39cyclictest0-21swapper/008:48:010
5194995529,12cyclictest0-21swapper/009:22:500
5194995529,12cyclictest0-21swapper/008:57:200
249662553,45sleep30-21swapper/308:16:023
245022553,45sleep10-21swapper/105:30:451
245022553,45sleep10-21swapper/105:30:451
107162554,12sleep10-21swapper/105:00:581
520199543,43cyclictest2820-21ssh06:56:013
520199543,43cyclictest2820-21ssh06:56:013
520199543,43cyclictest1287-21snmpd07:50:193
519999544,43cyclictest0-21swapper/210:15:452
519999543,12cyclictest0-21swapper/206:53:542
519999543,11cyclictest0-21swapper/208:11:072
519899544,31cyclictest0-21swapper/109:13:541
519899543,37cyclictest0-21swapper/109:06:111
519499545,34cyclictest0-21swapper/010:12:250
519499544,24cyclictest22228-21munin-node07:25:530
5194995428,12cyclictest0-21swapper/010:00:040
5194995428,12cyclictest0-21swapper/007:55:580
5194995428,12cyclictest0-21swapper/007:30:370
5194995426,12cyclictest0-21swapper/010:05:300
5194995425,13cyclictest0-21swapper/006:51:030
319062543,44sleep332001-21aten2.4-expect09:15:443
248599540,5rtkit-daemon2484-21rtkit-daemon07:04:572
248599540,5rtkit-daemon2484-21rtkit-daemon07:04:572
248599540,5rtkit-daemon2484-21rtkit-daemon05:36:303
248599540,5rtkit-daemon2484-21rtkit-daemon05:21:013
248599540,5rtkit-daemon2484-21rtkit-daemon05:10:543
248599540,4rtkit-daemon2484-21rtkit-daemon04:51:173
246082543,12sleep10-21swapper/109:50:581
206302543,44sleep10-21swapper/108:57:321
121732542,9sleep30-21swapper/309:33:183
73662533,8sleep07417-21diskstats07:50:510
520199534,42cyclictest27579-21irqstats09:55:533
520199534,11cyclictest17475-21iostat_ios09:40:503
520199534,11cyclictest17475-21iostat_ios09:40:503
520199533,11cyclictest0-21swapper/308:20:593
520199533,11cyclictest0-21swapper/308:20:593
519999534,43cyclictest30217-21diskmemload09:58:292
519999534,10cyclictest14716-21munin-node08:00:582
519999533,12cyclictest0-21swapper/210:05:442
519899536,41cyclictest0-21swapper/107:16:101
519899536,32cyclictest30217-21diskmemload10:15:101
519899536,26cyclictest3350-21yum08:31:081
519899535,30cyclictest0-21swapper/109:26:051
519899535,28cyclictest0-21swapper/105:50:411
519899535,23cyclictest8315-21aten2.4-expect08:40:441
519899535,13cyclictest0-21swapper/108:03:291
519899535,13cyclictest0-21swapper/106:50:091
519899534,13cyclictest0-21swapper/110:17:311
5198995321,13cyclictest0-21swapper/108:16:061
5198995321,13cyclictest0-21swapper/106:31:051
5194995328,12cyclictest0-21swapper/007:49:420
5194995327,12cyclictest0-21swapper/007:16:400
5194995325,12cyclictest0-21swapper/007:00:380
5194995325,12cyclictest0-21swapper/007:00:380
5194995313,24cyclictest0-21swapper/008:13:510
277212532,9sleep20-21swapper/206:44:222
248599530,5rtkit-daemon2484-21rtkit-daemon07:20:492
248599530,5rtkit-daemon2484-21rtkit-daemon07:05:572
520199524,41cyclictest10307-21ssh10:18:463
520199524,11cyclictest0-21swapper/306:55:103
520199523,43cyclictest7724-21ssh07:03:413
520199523,43cyclictest7724-21ssh07:03:413
520199523,42cyclictest2583-21ssh07:43:273
5201995213,34cyclictest0-21swapper/309:00:543
5201995213,34cyclictest0-21swapper/309:00:543
519999525,40cyclictest23828-21ssh08:15:482
519999525,40cyclictest1419-21runrttasks06:15:562
519999525,40cyclictest1419-21runrttasks06:15:562
519999524,42cyclictest0-21swapper/207:52:332
519999524,41cyclictest32483-21rm10:03:422
519999524,13cyclictest0-21swapper/207:37:022
5199995233,13cyclictest0-21swapper/209:15:472
519999523,42cyclictest17442-21rm07:16:292
519999523,41cyclictest21115-21ssh08:59:182
519999523,12cyclictest0-21swapper/207:31:322
519999523,11cyclictest0-21swapper/207:11:012
519899525,28cyclictest0-21swapper/108:11:041
519899525,27cyclictest12992-21munin-node05:36:021
519899525,13cyclictest0-21swapper/107:56:361
519899524,29cyclictest0-21swapper/107:36:231
5198995220,12cyclictest5701-21diskstats07:00:541
5198995220,12cyclictest5701-21diskstats07:00:541
5198995211,23cyclictest121850irq/46-eth010:07:051
519499523,26cyclictest0-21swapper/008:25:470
519499523,11cyclictest0-21swapper/006:12:280
5194995226,12cyclictest0-21swapper/006:45:490
5194995225,12cyclictest0-21swapper/008:36:000
5194995219,20cyclictest0-21swapper/005:15:060
312662522,9sleep00-21swapper/005:43:210
218362522,42sleep20-21swapper/205:25:052
204752523,42sleep30-21swapper/308:56:583
125782523,42sleep30-21swapper/306:11:063
520199515,16cyclictest0-21swapper/307:23:523
520199514,40cyclictest5792-21ssh09:24:413
5201995137,8cyclictest27399-21grep06:41:133
520199513,42cyclictest31948-21ssh07:40:083
520199513,41cyclictest30217-21diskmemload08:02:403
520199513,41cyclictest2411-21fgrep10:06:003
519999515,39cyclictest18296-21ssh09:41:032
519999515,39cyclictest18296-21ssh09:41:032
519999514,40cyclictest19062-21seq08:07:072
519999513,42cyclictest1287-21snmpd08:30:252
519999513,41cyclictest10651-21ssh09:30:522
519999513,40cyclictest11570-21ssh08:45:352
519899515,39cyclictest0-21swapper/108:23:301
519899515,39cyclictest0-21swapper/108:23:301
519899514,28cyclictest0-21swapper/108:36:161
519899514,28cyclictest0-21swapper/108:30:331
519899514,27cyclictest0-21swapper/105:25:411
519899514,13cyclictest0-21swapper/108:50:231
5198995133,11cyclictest14719-21crond05:10:401
519899513,35cyclictest0-21swapper/105:41:401
5198995122,11cyclictest17277-21grep09:40:471
5198995122,11cyclictest17277-21grep09:40:471
519499514,30cyclictest0-21swapper/008:30:580
519499514,28cyclictest0-21swapper/009:40:480
519499514,28cyclictest0-21swapper/009:40:480
519499514,28cyclictest0-21swapper/009:25:440
248599510,5rtkit-daemon2484-21rtkit-daemon05:40:533
219832513,42sleep10-21swapper/109:47:151
6382502,9sleep30-21swapper/308:29:123
520199505,39cyclictest18311-21ssh07:19:373
520199505,39cyclictest13040-21ssh07:59:443
5201995034,11cyclictest17322-21cut06:21:033
520199502,10cyclictest0-21swapper/307:30:213
519999504,12cyclictest0-21swapper/205:06:092
519999503,40cyclictest5726-21ssh09:24:272
519999503,40cyclictest32047-21kworker/2:208:34:332
5199995017,27cyclictest11911-21unixbench_multi05:01:152
519899505,13cyclictest0-21swapper/109:39:431
519899504,39cyclictest0-21swapper/105:51:141
519899504,28cyclictest0-21swapper/107:31:071
519499504,41cyclictest0-21swapper/005:36:250
519499504,28cyclictest0-21swapper/006:25:380
519499504,28cyclictest0-21swapper/005:06:150
519499503,24cyclictest17510-21telnet05:15:550
5194995022,12cyclictest0-21swapper/006:36:270
5194995022,11cyclictest0-21swapper/009:11:110
41682502,42sleep00-21swapper/005:55:510
256592503,40sleep10-21swapper/106:40:501
248599500,4rtkit-daemon2484-21rtkit-daemon04:56:023
105912502,9sleep30-21swapper/308:42:513
86312492,41sleep20-21swapper/206:04:402
520199495,38cyclictest0-21swapper/308:06:023
5201994932,10cyclictest20634-21head09:45:493
520199493,40cyclictest6996-21grep09:25:503
520199493,40cyclictest30217-21diskmemload08:47:193
520199493,39cyclictest13288-21missed_timers07:11:013
5201994914,30cyclictest361ktimersoftd/308:36:013
519999494,38cyclictest23272-21munin-node06:36:132
519999493,8cyclictest28711-21yum-updatesd-he05:36:362
519999493,38cyclictest281ktimersoftd/205:46:062
519899494,27cyclictest0-21swapper/106:36:021
519899494,27cyclictest0-21swapper/106:20:581
519899494,27cyclictest0-21swapper/106:06:121
519499494,28cyclictest0-21swapper/005:26:030
519499494,28cyclictest0-21swapper/004:55:570
519499494,24cyclictest0-21swapper/006:02:390
5194994934,8cyclictest30217-21diskmemload07:36:100
519499493,32cyclictest0-21swapper/005:31:040
519499493,32cyclictest0-21swapper/005:31:040
5194994919,12cyclictest0-21swapper/006:16:030
5194994919,12cyclictest0-21swapper/006:16:030
248599490,5rtkit-daemon2484-21rtkit-daemon05:31:153
248599490,5rtkit-daemon2484-21rtkit-daemon05:31:153
239542492,9sleep30-21swapper/305:26:353
235352493,37sleep20-21swapper/205:26:102
203042493,40sleep10-21swapper/106:26:151
167802492,9sleep20-21swapper/205:11:232
145272492,9sleep30-21swapper/305:08:133
122122492,42sleep00-21swapper/005:04:070
119552492,40sleep30-21swapper/305:01:163
520199484,9cyclictest2513-21udisks-daemon06:31:113
520199484,9cyclictest18385-21munin-node05:16:053
5199994833,9cyclictest7890-21aten2.4-expect04:55:532
519999483,38cyclictest4294-21telnet05:55:532
519499484,27cyclictest0-21swapper/006:41:070
519499484,27cyclictest0-21swapper/005:46:020
313182482,9sleep20-21swapper/205:44:042
85502472,39sleep30-21swapper/306:03:363
520199474,38cyclictest0-21swapper/308:52:523
519999474,28cyclictest0-21swapper/206:21:052
519999473,38cyclictest1725-21telnet05:50:522
5198994717,12cyclictest0-21swapper/106:11:061
519499474,26cyclictest0-21swapper/006:30:060
248599470,4rtkit-daemon2484-21rtkit-daemon06:25:583
248599470,4rtkit-daemon2484-21rtkit-daemon05:51:073
171062473,38sleep10-21swapper/105:15:371
520199463,28cyclictest0-21swapper/305:45:593
5201994617,13cyclictest0-21swapper/306:15:593
5201994617,13cyclictest0-21swapper/306:15:593
519999464,27cyclictest0-21swapper/204:50:532
5199994615,24cyclictest18590-21tail06:25:502
5198994618,12cyclictest0-21swapper/105:29:561
519499465,25cyclictest0-21swapper/006:35:070
216372462,9sleep00-21swapper/005:22:290
520199453,38cyclictest0-21swapper/306:06:133
520199453,36cyclictest0-21swapper/306:36:043
5199994521,11cyclictest0-21swapper/206:11:062
5199994518,7cyclictest11103-21latency_hist06:10:392
519499455,33cyclictest0-21swapper/004:50:430
519499455,33cyclictest0-21swapper/004:50:430
36702452,37sleep00-21swapper/005:52:160
301562452,9sleep20-21swapper/206:50:022
230022442,35sleep20-21swapper/206:35:152
158612443,9sleep10-21swapper/106:20:311
158612443,9sleep10-21swapper/106:20:311
520199434,33cyclictest1287-21snmpd06:00:013
519999434,26cyclictest0-21swapper/205:15:552
5199994317,20cyclictest5177-21latency_hist04:50:422
5199994317,20cyclictest5177-21latency_hist04:50:422
520199405,29cyclictest5232-21cat04:50:423
520199405,29cyclictest5232-21cat04:50:423
5198993921,12cyclictest0-21swapper/104:50:431
5198993921,12cyclictest0-21swapper/104:50:431
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional