You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-07 - 16:01

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot6s.osadl.org (updated Sat Mar 07, 2026 12:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
51499884,34cyclictest0-21swapper/108:16:001
51499883,25cyclictest7555-21timerandwakeup09:21:101
51499864,32cyclictest0-21swapper/110:36:001
51499864,32cyclictest0-21swapper/110:36:001
51499863,35cyclictest31356-21gltestperf10:45:561
51499863,31cyclictest0-21swapper/109:52:401
514998625,9cyclictest3063-21basename05:55:471
516998531,45cyclictest18361-21gltestperf11:15:553
51499853,34cyclictest3074-21ssh09:15:581
54102840,4sleep334-21rcuc/307:06:053
54102840,4sleep334-21rcuc/307:06:053
516998426,49cyclictest0-21swapper/309:14:083
516998426,49cyclictest0-21swapper/309:14:083
51499844,32cyclictest0-21swapper/109:41:051
51499844,12cyclictest0-21swapper/110:09:151
51499843,34cyclictest0-21swapper/111:01:081
514998426,9cyclictest31357-21fschecks_count08:01:001
514998425,11cyclictest16047-21gltestperf06:21:051
514998425,11cyclictest16047-21gltestperf06:21:051
514998425,10cyclictest13425-21fschecks_count08:31:001
514998425,10cyclictest13425-21fschecks_count08:31:001
516998336,27cyclictest1571-21grep05:51:053
516998325,50cyclictest0-21swapper/309:35:383
51499834,34cyclictest0-21swapper/106:41:151
51499834,12cyclictest0-21swapper/107:01:211
51499833,33cyclictest0-21swapper/108:00:111
516998232,28cyclictest4245-21unixbench_singl09:16:143
516998227,36cyclictest0-21swapper/306:02:303
51499824,30cyclictest0-21swapper/109:26:041
51499824,12cyclictest0-21swapper/111:11:011
514998232,8cyclictest8879-21head06:06:061
51499823,33cyclictest0-21swapper/109:46:071
51499823,32cyclictest0-21swapper/109:56:061
51499823,32cyclictest0-21swapper/109:56:061
51499823,12cyclictest0-21swapper/108:36:041
51499823,10cyclictest1508-21cpuspeed_turbos10:50:501
516998132,17cyclictest5474-21sort10:55:593
51499814,34cyclictest0-21swapper/109:14:081
51499814,34cyclictest0-21swapper/109:14:081
51499814,32cyclictest0-21swapper/110:31:111
51499814,30cyclictest0-21swapper/106:16:101
51499814,13cyclictest0-21swapper/110:17:471
514998130,8cyclictest10686-21cpuspeed_turbos08:25:531
51499813,34cyclictest0-21swapper/110:21:041
514998125,10cyclictest18108-21cstates10:25:511
514998118,9cyclictest31958-21munin-node06:56:171
516998035,25cyclictest23980-21gltestperf09:46:023
516998034,31cyclictest29579-21telnet09:05:523
516998034,28cyclictest139991munin-node07:26:153
516998029,31cyclictest0-21swapper/310:50:363
51499804,12cyclictest0-21swapper/110:11:271
51499803,31cyclictest0-21swapper/106:47:391
516997929,43cyclictest0-21swapper/309:21:103
516997929,42cyclictest0-21swapper/309:36:063
516997916,55cyclictest0-21swapper/308:21:533
51499794,33cyclictest0-21swapper/108:10:411
248599790,5rtkit-daemon2484-21rtkit-daemon07:47:342
248599790,5rtkit-daemon2484-21rtkit-daemon07:47:342
516997831,38cyclictest27188-21aten_r1power_en09:00:513
516997830,31cyclictest11517-21ssh09:26:553
516997828,43cyclictest0-21swapper/308:02:293
516997828,32cyclictest0-21swapper/310:21:333
516997827,36cyclictest0-21swapper/310:42:033
516997827,36cyclictest0-21swapper/310:42:033
516997827,30cyclictest22234-21sed10:30:593
516997825,33cyclictest0-21swapper/310:02:433
516997823,35cyclictest0-21swapper/311:15:143
51499783,35cyclictest0-21swapper/109:35:591
514997829,8cyclictest20942-21munin-run07:40:421
516997734,26cyclictest20540-21ssh09:40:573
516997725,34cyclictest0-21swapper/306:46:133
51499775,32cyclictest0-21swapper/111:06:051
51499773,24cyclictest1859-21ssh10:01:011
516997634,27cyclictest27187-21tune2fs09:50:553
516997631,38cyclictest9200-21grep11:01:073
516997629,31cyclictest26498-21awk06:41:193
516997530,39cyclictest4705-21grep05:56:163
516997530,26cyclictest17381-21crond06:25:453
516997530,26cyclictest17381-21crond06:25:453
516997526,31cyclictest0-21swapper/308:00:433
516997524,42cyclictest12175-21sh11:06:043
516997429,36cyclictest24596-21sh10:35:523
516997429,36cyclictest24596-21sh10:35:523
516997427,40cyclictest0-21swapper/306:51:113
515997453,12cyclictest8048-21grep07:11:062
51499746,29cyclictest0-21swapper/108:20:561
51499744,31cyclictest0-21swapper/110:41:561
51499744,31cyclictest0-21swapper/110:41:561
51499743,34cyclictest0-21swapper/109:34:051
514997428,8cyclictest28196-21sort09:01:031
514997425,10cyclictest0-21swapper/111:17:091
516997330,28cyclictest6004-21timerwakeupswit10:06:133
516997328,37cyclictest298391munin-node09:56:133
516997328,37cyclictest298391munin-node09:56:133
516997327,36cyclictest8135-21ssh10:10:513
516997324,32cyclictest0-21swapper/307:36:003
514997325,9cyclictest22827-21unixbench-2d07:41:161
514997316,11cyclictest0-21swapper/107:10:541
516997230,35cyclictest1419-21runrttasks07:00:573
516997230,26cyclictest17618-21munin-node06:25:593
516997228,35cyclictest22392-21munin-node06:36:063
516997227,38cyclictest0-21swapper/310:15:553
516997223,41cyclictest0-21swapper/308:36:053
516997221,33cyclictest0-21swapper/310:26:193
514997220,14cyclictest0-21swapper/107:10:451
514997220,14cyclictest0-21swapper/107:10:451
516997130,26cyclictest12602-21taskset06:15:443
516997124,32cyclictest0-21swapper/310:51:023
516997123,41cyclictest0-21swapper/307:16:023
516997027,27cyclictest11888-21tr07:20:563
516996932,31cyclictest18325-21taskset07:32:553
516996931,31cyclictest26819-21gltestperf07:51:023
516996931,31cyclictest26819-21gltestperf07:51:023
516996929,25cyclictest14454-21sed06:16:183
516996924,26cyclictest25892-21missed_timers08:56:033
516996923,38cyclictest23092-21taskset07:42:333
516996923,30cyclictest0-21swapper/308:06:103
516996921,31cyclictest0-21swapper/308:45:513
51499695,17cyclictest0-21swapper/106:00:591
514996923,9cyclictest17918-21cpuspeed_turbos06:26:011
516996829,24cyclictest7864-21irqstats07:11:043
516996829,24cyclictest14570-21vmstat08:31:163
516996829,24cyclictest14570-21vmstat08:31:163
516996825,23cyclictest0-21swapper/308:15:553
516996731,29cyclictest0-21swapper/308:44:163
516996723,28cyclictest8159-21aten_r1power_fr06:05:583
516996617,41cyclictest0-21swapper/306:56:133
516996522,28cyclictest0-21swapper/308:27:353
516996521,38cyclictest0-21swapper/308:10:593
516996436,21cyclictest24383-21gltestperf07:46:023
516996436,21cyclictest24383-21gltestperf07:46:023
516996424,14cyclictest0-21swapper/308:55:403
510996426,23cyclictest0-21swapper/009:38:360
516996318,29cyclictest0-21swapper/305:50:483
51099633,44cyclictest0-21swapper/009:14:110
51099633,44cyclictest0-21swapper/009:14:110
516996244,11cyclictest21427-21sendmail_mailqu06:31:133
51499613,14cyclictest0-21swapper/108:45:541
95072603,50sleep20-21swapper/209:25:552
51599604,11cyclictest10803-21munin-node11:06:002
51599594,12cyclictest0-21swapper/209:55:572
51599594,12cyclictest0-21swapper/209:55:572
51599594,12cyclictest0-21swapper/208:35:582
510995924,30cyclictest0-21swapper/009:52:070
51599584,34cyclictest26176-21ssh10:36:532
51599584,34cyclictest26176-21ssh10:36:532
51599584,13cyclictest0-21swapper/210:17:572
51599584,12cyclictest0-21swapper/210:06:102
51599584,12cyclictest0-21swapper/209:46:102
51599584,12cyclictest0-21swapper/209:21:092
51599584,12cyclictest0-21swapper/209:14:102
51599584,12cyclictest0-21swapper/209:14:102
51099584,37cyclictest0-21swapper/010:20:590
51599575,12cyclictest15554-21yum-updatesd-he09:33:472
515995739,11cyclictest15025-21gltestperf11:10:552
51099575,14cyclictest0-21swapper/009:23:150
510995727,13cyclictest0-21swapper/006:06:150
51599565,27cyclictest0-21swapper/208:24:352
51599564,13cyclictest0-21swapper/209:39:452
51499565,43cyclictest0-21swapper/106:50:561
51099565,35cyclictest0-21swapper/010:19:550
510995637,12cyclictest0-21swapper/010:10:550
510995626,13cyclictest0-21swapper/010:46:090
510995621,16cyclictest0-21swapper/009:58:260
510995621,16cyclictest0-21swapper/009:58:260
51599554,32cyclictest0-21swapper/210:31:092
51599554,31cyclictest0-21swapper/206:11:002
515995522,27cyclictest1419-21runrttasks08:12:492
515995511,26cyclictest1419-21runrttasks10:44:122
515995511,26cyclictest1419-21runrttasks10:44:122
510995537,11cyclictest0-21swapper/009:34:120
510995535,13cyclictest0-21swapper/010:55:480
32852553,10sleep00-21swapper/007:01:110
225662553,8sleep022701-21cpuspeed_turbos06:36:000
51599549,29cyclictest0-21swapper/209:20:152
51599544,33cyclictest0-21swapper/207:00:592
51599544,32cyclictest0-21swapper/211:01:042
515995437,10cyclictest8776-21grep06:06:052
51099544,29cyclictest0-21swapper/008:51:210
510995435,14cyclictest0-21swapper/011:00:400
510995435,13cyclictest0-21swapper/011:17:420
510995420,14cyclictest0-21swapper/007:21:010
327612542,11sleep00-21swapper/006:56:040
248599540,4rtkit-daemon2484-21rtkit-daemon11:11:120
51599535,34cyclictest0-21swapper/210:00:512
51599534,31cyclictest0-21swapper/206:16:022
51599534,30cyclictest0-21swapper/207:50:552
51599534,30cyclictest0-21swapper/207:50:552
51599534,30cyclictest0-21swapper/207:26:012
51599534,27cyclictest0-21swapper/206:55:562
515995321,13cyclictest0-21swapper/210:21:382
51099535,39cyclictest0-21swapper/007:36:020
51099535,29cyclictest0-21swapper/006:51:020
510995335,14cyclictest0-21swapper/009:29:090
510995335,13cyclictest0-21swapper/010:40:050
510995335,13cyclictest0-21swapper/010:40:050
510995334,14cyclictest0-21swapper/009:46:540
510995332,16cyclictest0-21swapper/009:18:550
51099533,44cyclictest0-21swapper/005:51:070
268382533,43sleep00-21swapper/006:44:190
51599525,28cyclictest0-21swapper/209:10:402
51599525,28cyclictest0-21swapper/206:51:032
51599525,27cyclictest0-21swapper/210:51:032
51599525,27cyclictest0-21swapper/209:41:012
51599524,30cyclictest0-21swapper/207:36:022
51599524,29cyclictest0-21swapper/210:57:352
51599524,29cyclictest0-21swapper/207:31:062
51599524,28cyclictest0-21swapper/210:50:372
51599524,27cyclictest0-21swapper/208:50:332
515995233,11cyclictest15600-21grep06:21:002
515995233,11cyclictest15600-21grep06:21:002
51599523,30cyclictest0-21swapper/211:16:002
515995221,13cyclictest0-21swapper/208:01:092
515995220,14cyclictest0-21swapper/206:27:292
515995219,15cyclictest0-21swapper/205:55:482
51499524,10cyclictest0-21swapper/107:31:191
51099525,29cyclictest0-21swapper/006:46:110
51099525,28cyclictest0-21swapper/006:31:130
51099525,28cyclictest0-21swapper/005:56:160
51099524,29cyclictest0-21swapper/010:07:100
51099524,29cyclictest0-21swapper/008:21:100
51099524,29cyclictest0-21swapper/008:16:010
510995236,12cyclictest0-21swapper/010:33:030
510995234,14cyclictest0-21swapper/011:08:160
510995233,11cyclictest21098-21ssh09:41:060
510995232,15cyclictest0-21swapper/008:01:090
510995232,14cyclictest0-21swapper/008:36:130
510995231,15cyclictest0-21swapper/010:01:000
510995231,15cyclictest0-21swapper/005:50:480
510995221,13cyclictest0-21swapper/007:16:020
510995219,14cyclictest0-21swapper/010:40:490
510995219,14cyclictest0-21swapper/010:40:490
212582522,10sleep20-21swapper/206:31:112
196122523,12sleep00-21swapper/010:26:160
51599515,28cyclictest0-21swapper/210:25:522
51599514,33cyclictest0-21swapper/209:51:172
51599514,29cyclictest0-21swapper/210:14:242
51599514,29cyclictest0-21swapper/206:41:172
51599514,29cyclictest0-21swapper/206:36:042
51599514,28cyclictest0-21swapper/209:00:402
51599513,30cyclictest0-21swapper/208:40:552
515995119,13cyclictest0-21swapper/208:30:562
515995119,13cyclictest0-21swapper/208:30:562
51099515,28cyclictest0-21swapper/010:52:450
51099514,28cyclictest0-21swapper/009:06:040
510995133,13cyclictest0-21swapper/007:11:120
510995131,14cyclictest0-21swapper/008:46:130
510995131,13cyclictest0-21swapper/006:15:460
510995123,13cyclictest0-21swapper/006:01:090
194592513,11sleep00-21swapper/008:42:120
147342514,41sleep00-21swapper/006:17:300
51599504,29cyclictest0-21swapper/208:51:002
51599504,28cyclictest0-21swapper/209:00:572
51599504,28cyclictest0-21swapper/208:25:542
51599504,28cyclictest0-21swapper/207:56:022
51599504,28cyclictest0-21swapper/207:20:552
51599504,28cyclictest0-21swapper/206:45:592
51599504,28cyclictest0-21swapper/206:05:462
51599504,27cyclictest5247-21fschecks_time07:06:032
51599504,27cyclictest5247-21fschecks_time07:06:032
515995019,13cyclictest0-21swapper/208:16:002
510995023,7cyclictest14935-21latency_hist08:35:420
510995023,7cyclictest14935-21latency_hist08:35:420
302712503,41sleep00-21swapper/007:57:420
280432503,41sleep00-21swapper/007:54:480
280432503,41sleep00-21swapper/007:54:480
273532506,37sleep027503-21cstates09:00:540
51599494,28cyclictest0-21swapper/205:56:162
514994913,12cyclictest0-21swapper/107:46:011
514994913,12cyclictest0-21swapper/107:46:011
51099494,28cyclictest0-21swapper/008:06:070
510994933,11cyclictest0-21swapper/006:26:080
510994932,12cyclictest0-21swapper/007:40:550
510994922,13cyclictest0-21swapper/007:06:040
510994922,13cyclictest0-21swapper/007:06:040
510994919,12cyclictest0-21swapper/007:46:060
510994919,12cyclictest0-21swapper/007:46:060
510994918,13cyclictest0-21swapper/008:56:000
515994818,12cyclictest0-21swapper/207:41:022
51099484,25cyclictest0-21swapper/006:20:580
51099484,25cyclictest0-21swapper/006:20:580
51099484,13cyclictest0-21swapper/008:15:410
510994829,14cyclictest0-21swapper/007:31:170
124772483,38sleep00-21swapper/008:29:540
51599474,23cyclictest0-21swapper/208:05:552
220322474,38sleep10-21swapper/106:34:121
51599463,26cyclictest0-21swapper/207:16:032
515994617,12cyclictest0-21swapper/205:50:482
51099464,36cyclictest0-21swapper/007:26:180
32312463,35sleep10-21swapper/108:10:491
51499457,33cyclictest0-21swapper/110:57:081
51499453,36cyclictest27372-21rt-features07:51:121
51499453,36cyclictest27372-21rt-features07:51:121
51499444,25cyclictest0-21swapper/108:51:181
51499434,33cyclictest0-21swapper/108:56:101
514994330,7cyclictest0-21swapper/105:50:471
51499433,34cyclictest30824-21open_inodes09:06:081
124292433,33sleep10-21swapper/106:13:321
51499423,33cyclictest0-21swapper/105:57:591
51499414,31cyclictest0-21swapper/107:20:441
51499413,33cyclictest15414-21rt-features07:26:131
514994128,8cyclictest23535-21sort06:36:111
514994113,13cyclictest0-21swapper/107:21:141
514994025,10cyclictest17904-21cpuspeed_turbos08:40:551
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional