You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-26 - 17:05

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot6s.osadl.org (updated Wed Aug 26, 2026 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
13510999519,12cyclictest0-21swapper/108:26:051
13510999318,12cyclictest0-21swapper/107:45:581
1351299924,69cyclictest20611-21perl08:06:053
1351299924,68cyclictest0-21swapper/309:11:033
1351299923,67cyclictest26240-21unixbench_multi09:51:173
13510999220,8cyclictest17782-21sed08:51:001
1351299914,79cyclictest0-21swapper/308:57:093
1351299914,73cyclictest0-21swapper/308:19:443
1351299904,69cyclictest0-21swapper/310:16:123
1351299894,69cyclictest0-21swapper/310:29:323
1351299894,64cyclictest11858-21diskstats09:30:593
1351299884,76cyclictest0-21swapper/308:32:313
1351299884,65cyclictest0-21swapper/310:31:123
1351299883,48cyclictest0-21swapper/308:24:283
1351299875,59cyclictest2410-21ssh10:05:553
1351299875,59cyclictest2410-21ssh10:05:553
1351299874,65cyclictest0-21swapper/308:45:583
1351299874,64cyclictest0-21swapper/309:49:293
1351299873,76cyclictest9915-21cpuspeed07:51:003
1351299873,76cyclictest14134-21irqstats07:56:113
1351299864,74cyclictest1124-21snmpd08:27:453
1351299864,74cyclictest0-21swapper/308:51:023
1351299864,64cyclictest0-21swapper/311:01:533
1351299854,74cyclictest0-21swapper/309:45:143
1351299854,62cyclictest0-21swapper/309:40:443
1351299853,74cyclictest27812-21crond06:15:513
1351099855,27cyclictest0-21swapper/107:56:211
1351099854,73cyclictest0-21swapper/111:05:501
1351299844,72cyclictest15101-21ssh11:14:033
1351299844,71cyclictest0-21swapper/310:55:473
1351099844,73cyclictest0-21swapper/108:01:161
1351099844,73cyclictest0-21swapper/108:01:161
1351099844,30cyclictest0-21swapper/110:27:411
1351099844,27cyclictest0-21swapper/110:19:161
1351099844,12cyclictest0-21swapper/108:11:581
1351299837,58cyclictest0-21swapper/308:11:083
1351299835,71cyclictest0-21swapper/310:21:423
1351299835,62cyclictest0-21swapper/310:40:553
1351299834,71cyclictest2436-21iostat_ios09:16:043
1351299834,61cyclictest0-21swapper/310:13:123
1351299834,56cyclictest0-21swapper/308:45:443
1351299834,56cyclictest0-21swapper/308:45:443
1351299834,53cyclictest0-21swapper/310:01:233
1351299834,53cyclictest0-21swapper/309:04:543
13512998314,51cyclictest0-21swapper/309:21:213
13512998314,51cyclictest0-21swapper/309:21:213
13512998313,47cyclictest0-21swapper/306:33:593
1351099838,21cyclictest0-21swapper/109:23:141
1351099838,21cyclictest0-21swapper/109:23:141
1351099835,22cyclictest0-21swapper/110:51:031
1351099834,71cyclictest0-21swapper/108:30:581
1351099833,24cyclictest0-21swapper/110:33:021
13510998320,10cyclictest10288-21sort07:51:041
13510998315,9cyclictest26131-21grep09:51:161
1351299825,62cyclictest0-21swapper/309:06:173
1351299824,71cyclictest0-21swapper/311:06:083
1351299824,69cyclictest30119-21ssh09:58:143
1351299824,56cyclictest0-21swapper/309:26:093
1351299824,56cyclictest0-21swapper/309:26:093
1351299823,54cyclictest6650-21cut07:45:593
1351299822,57cyclictest18776-21ssh08:03:003
1351299822,57cyclictest18776-21ssh08:03:003
13512998210,55cyclictest28965-21fschecks_count10:45:583
13512998210,55cyclictest28965-21fschecks_count10:45:583
1351099824,23cyclictest0-21swapper/110:41:071
13510998234,41cyclictest6260-21systemd-cgroups07:45:471
1351099823,72cyclictest0-21swapper/110:02:191
1351099823,70cyclictest6192-21gltestperf10:11:021
1351099823,18cyclictest0-21swapper/110:45:591
1351099823,18cyclictest0-21swapper/110:45:591
13510998223,7cyclictest1227-21runrttasks06:27:221
1351299815,64cyclictest0-21swapper/308:35:513
1351299814,62cyclictest32696-21iostat_ios10:51:033
13512998111,47cyclictest0-21swapper/306:48:173
1351099818,21cyclictest0-21swapper/108:50:261
1351099816,14cyclictest0-21swapper/109:12:241
1351099814,69cyclictest0-21swapper/109:31:161
1351099814,27cyclictest0-21swapper/110:22:101
13510998130,45cyclictest5586-21cpuspeed_turbos06:36:031
13510998130,45cyclictest5586-21cpuspeed_turbos06:36:031
1351099813,71cyclictest0-21swapper/108:23:371
1351099813,70cyclictest0-21swapper/108:16:061
1351099813,13cyclictest0-21swapper/108:06:151
1351299804,65cyclictest0-21swapper/307:40:013
1351299804,53cyclictest0-21swapper/305:51:193
1351299803,8cyclictest2207-21metacity07:14:473
1351299803,67cyclictest0-21swapper/310:40:313
1351099805,24cyclictest0-21swapper/107:10:081
1351099804,69cyclictest0-21swapper/111:12:001
1351099804,12cyclictest0-21swapper/110:56:081
1351099804,12cyclictest0-21swapper/110:06:041
1351099804,12cyclictest0-21swapper/110:06:041
1351099803,30cyclictest0-21swapper/109:35:561
1351099803,27cyclictest6251-21diskmemload09:42:131
13510998018,13cyclictest0-21swapper/109:26:091
13510998018,13cyclictest0-21swapper/109:26:091
13510998014,8cyclictest6251-21diskmemload08:40:391
274112790,11sleep2281ktimersoftd/209:55:282
219499790,4rtkit-daemon2193-21rtkit-daemon09:46:430
1351299794,42cyclictest0-21swapper/306:36:173
1351299794,42cyclictest0-21swapper/306:36:173
1351299793,63cyclictest18569-21cut05:56:033
1351299793,63cyclictest18569-21cut05:56:033
1351299793,52cyclictest26805-21munin-node07:21:213
1351299793,52cyclictest26805-21munin-node07:21:213
1351099794,69cyclictest0-21swapper/111:00:511
1351099794,31cyclictest24114-21cpuspeed_turbos09:00:591
1351099794,24cyclictest0-21swapper/107:28:051
1351099794,11cyclictest0-21swapper/109:57:501
1351099793,12cyclictest0-21swapper/109:06:031
13510997921,8cyclictest21617-21fschecks_time06:01:091
1351299783,53cyclictest18777-1kworker/3:2H06:05:513
1351299783,52cyclictest15394-21df_abs06:56:043
1351099784,68cyclictest0-21swapper/109:46:171
1351099784,12cyclictest0-21swapper/108:57:141
1351099783,26cyclictest26239-21munin-node06:11:071
1351099783,26cyclictest0-21swapper/107:31:151
1351099783,24cyclictest0-21swapper/106:21:191
13510997825,9cyclictest22592-21gltestperf10:35:591
1351299774,52cyclictest29196-21munin-node07:26:173
1351299773,8cyclictest7938-21ls06:41:033
1351099774,30cyclictest0-21swapper/108:41:151
1351099774,30cyclictest0-21swapper/108:41:151
1351099773,67cyclictest0-21swapper/107:36:181
1351099773,28cyclictest19255-21fschecks_time05:56:101
1351099773,28cyclictest19255-21fschecks_time05:56:101
1351299765,48cyclictest0-21swapper/306:55:513
1351299764,57cyclictest0-21swapper/306:19:003
1351299764,49cyclictest0-21swapper/307:41:203
1351299763,50cyclictest12057-1kworker/3:2H07:35:483
13512997610,45cyclictest0-21swapper/306:21:073
13510997618,9cyclictest3067-21timerwakeupswit09:16:151
13510997618,11cyclictest12089-21sshd06:48:481
13510997618,10cyclictest24448-21aten_r1power_cu07:15:591
1351299753,65cyclictest0-21swapper/305:46:103
13512997510,45cyclictest107550irq/46-eth006:06:033
1351099753,11cyclictest0-21swapper/106:51:001
13510997522,7cyclictest27843-21kernelversion07:21:101
13510997522,7cyclictest27843-21kernelversion07:21:101
13510997521,9cyclictest23774-21unixbench_singl07:11:231
13510997518,10cyclictest28691-21fschecks_count06:16:091
13510997423,9cyclictest13822-21aten2.4-expect05:46:041
13510997423,8cyclictest4692-21unixbench_singl06:31:231
1351299733,57cyclictest0-21swapper/306:26:113
1351099733,28cyclictest0-21swapper/106:56:151
1351299724,61cyclictest0-21swapper/307:06:183
1351299724,61cyclictest0-21swapper/307:01:223
219499710,5rtkit-daemon2193-21rtkit-daemon05:46:230
1351299713,62cyclictest0-21swapper/307:16:063
8272700,16sleep21351199cyclictest09:15:162
13510997021,8cyclictest18059-21gltestperf07:01:081
1351299694,58cyclictest0-21swapper/305:45:533
13510996820,8cyclictest24952-21unixbench-2d06:06:241
28222677,13sleep20-21swapper/210:55:552
148202675,13sleep20-21swapper/210:25:202
1351099673,12cyclictest0-21swapper/106:41:011
1351199665,52cyclictest0-21swapper/208:26:222
1351099663,14cyclictest0-21swapper/105:51:211
219499650,4rtkit-daemon2193-21rtkit-daemon11:15:320
1351199654,53cyclictest0-21swapper/208:16:452
1351199654,13cyclictest0-21swapper/209:26:082
1351199654,13cyclictest0-21swapper/209:26:082
1351199634,51cyclictest0-21swapper/210:01:002
1351199634,15cyclictest0-21swapper/208:01:032
1351199634,15cyclictest0-21swapper/208:01:032
13509996344,12cyclictest0-21swapper/009:30:590
13509996311,14cyclictest0-21swapper/009:56:130
162682623,52sleep20-21swapper/208:48:122
1351199624,13cyclictest0-21swapper/210:06:092
1351199624,13cyclictest0-21swapper/210:06:092
13509996245,12cyclictest0-21swapper/010:31:140
1350999623,32cyclictest0-21swapper/010:47:360
1350999623,32cyclictest0-21swapper/010:47:360
214942613,12sleep20-21swapper/208:56:062
1351199614,50cyclictest0-21swapper/210:46:092
1351199614,50cyclictest0-21swapper/210:46:092
1351199613,13cyclictest0-21swapper/209:20:442
13509996143,13cyclictest0-21swapper/006:31:150
128052613,9sleep212948-21latency_hist07:55:482
114602614,50sleep00-21swapper/011:07:390
13509996042,13cyclictest0-21swapper/009:21:030
13509996042,13cyclictest0-21swapper/009:21:030
13509996042,12cyclictest0-21swapper/010:27:360
117852605,12sleep011906-21diskstats05:41:080
313182595,47sleep231370-21idleruntime06:21:112
219499590,5rtkit-daemon2193-21rtkit-daemon07:21:340
219499590,5rtkit-daemon2193-21rtkit-daemon07:21:340
219499590,4rtkit-daemon2193-21rtkit-daemon07:35:560
219499590,4rtkit-daemon2193-21rtkit-daemon07:33:560
1351199593,14cyclictest0-21swapper/211:15:402
13509995942,11cyclictest0-21swapper/008:02:300
13509995942,11cyclictest0-21swapper/008:02:300
13509995940,12cyclictest4177-21ssh08:30:590
13509995928,25cyclictest0-21swapper/010:51:080
72932583,10sleep00-21swapper/008:35:570
229342584,47sleep00-21swapper/006:04:320
219499580,5rtkit-daemon2193-21rtkit-daemon10:16:570
219499580,5rtkit-daemon2193-21rtkit-daemon06:38:200
219499580,5rtkit-daemon2193-21rtkit-daemon06:38:200
198312583,8sleep019836-21ssh09:41:360
1351199585,30cyclictest0-21swapper/211:07:002
13511995813,27cyclictest0-21swapper/209:06:132
13509995843,11cyclictest0-21swapper/010:36:220
13509995842,11cyclictest0-21swapper/008:10:590
13509995842,10cyclictest9386-21ssh07:50:470
13509995840,12cyclictest0-21swapper/008:55:580
13509995838,14cyclictest0-21swapper/007:51:010
13509995835,16cyclictest0-21swapper/009:25:560
13509995835,16cyclictest0-21swapper/009:25:560
13509995828,8cyclictest26833-21latency_hist09:05:440
13509995823,30cyclictest32125-21unixbench-2d09:11:180
227882573,13sleep20-21swapper/207:11:092
1351199575,46cyclictest0-21swapper/208:42:392
1351199575,46cyclictest0-21swapper/208:42:392
1351199574,11cyclictest0-21swapper/206:35:502
1351199574,10cyclictest5319-21fschecks_count09:21:032
1351199574,10cyclictest5319-21fschecks_count09:21:032
13511995737,11cyclictest24183-21grep09:00:592
1351199573,45cyclictest12505-21head09:31:082
1351199572,38cyclictest0-21swapper/208:15:232
13509995740,10cyclictest0-21swapper/010:12:530
13509995739,13cyclictest0-21swapper/005:56:230
13509995739,13cyclictest0-21swapper/005:56:230
13509995736,16cyclictest0-21swapper/009:52:560
13509995735,17cyclictest0-21swapper/007:11:190
88422563,12sleep00-21swapper/011:05:130
1351199569,27cyclictest0-21swapper/207:56:092
1351199567,27cyclictest0-21swapper/210:16:092
1351199564,39cyclictest0-21swapper/208:08:322
1351199564,12cyclictest0-21swapper/210:54:152
1351199564,12cyclictest0-21swapper/209:46:322
1351199564,12cyclictest0-21swapper/209:41:032
13511995611,26cyclictest0-21swapper/206:30:512
13509995639,11cyclictest1227-21runrttasks08:29:250
13509995639,11cyclictest0-21swapper/009:10:450
13509995638,11cyclictest3598-21munin-node10:56:020
13509995637,14cyclictest0-21swapper/008:51:010
13509995636,14cyclictest0-21swapper/010:01:080
13509995633,17cyclictest0-21swapper/006:06:190
13509995624,14cyclictest0-21swapper/008:16:100
13509995620,14cyclictest0-21swapper/010:41:040
60302554,42sleep20-21swapper/207:43:062
254242553,8sleep225436-21idleruntime-cro06:10:512
160632553,46sleep00-21swapper/008:47:260
1351199555,24cyclictest16550-21ssh09:36:422
1351199554,30cyclictest0-21swapper/206:01:042
13511995522,12cyclictest8358-21munin-run10:15:422
13511995516,23cyclictest0-21swapper/208:30:512
13509995541,10cyclictest0-21swapper/008:21:530
13509995535,15cyclictest0-21swapper/009:20:230
219499540,5rtkit-daemon2193-21rtkit-daemon06:55:500
1351199545,29cyclictest0-21swapper/209:56:032
1351199545,14cyclictest0-21swapper/210:26:232
1351199544,26cyclictest0-21swapper/211:00:572
13511995435,11cyclictest29799-21unixbench_singl06:16:252
1351199543,12cyclictest0-21swapper/208:55:182
13511995422,13cyclictest0-21swapper/208:36:072
13511995422,11cyclictest21767-21ssh10:35:502
13509995435,13cyclictest0-21swapper/010:06:120
13509995435,13cyclictest0-21swapper/010:06:120
13509995433,14cyclictest0-21swapper/007:06:010
13509995427,21cyclictest0-21swapper/010:21:130
277152533,44sleep00-21swapper/006:14:400
264352533,44sleep00-21swapper/007:19:050
219499530,5rtkit-daemon2193-21rtkit-daemon06:26:060
219499530,5rtkit-daemon2193-21rtkit-daemon05:51:150
1351199536,27cyclictest0-21swapper/208:21:102
1351199535,28cyclictest0-21swapper/207:36:192
1351199534,29cyclictest0-21swapper/205:56:132
1351199534,29cyclictest0-21swapper/205:56:132
1351199534,28cyclictest0-21swapper/207:00:492
1351199534,14cyclictest0-21swapper/210:45:142
13511995320,14cyclictest0-21swapper/207:50:182
1350999535,29cyclictest0-21swapper/006:46:060
1350999534,29cyclictest0-21swapper/007:26:200
116142534,43sleep011665-21iostat_ios08:41:090
116142534,43sleep011665-21iostat_ios08:41:090
59712524,41sleep00-21swapper/007:42:190
219499520,5rtkit-daemon2193-21rtkit-daemon07:00:500
219499520,5rtkit-daemon2193-21rtkit-daemon06:20:510
1351199525,28cyclictest0-21swapper/206:36:112
1351199525,28cyclictest0-21swapper/206:36:112
1351199524,29cyclictest0-21swapper/207:26:052
1351199524,27cyclictest0-21swapper/206:48:002
13509995233,14cyclictest0-21swapper/009:36:100
13509995232,15cyclictest0-21swapper/008:08:560
288382512,11sleep20-21swapper/207:24:192
288382512,11sleep20-21swapper/207:24:192
146242512,43sleep20-21swapper/206:55:422
1351199514,29cyclictest0-21swapper/207:16:022
1351199514,29cyclictest0-21swapper/206:11:082
1351199514,28cyclictest0-21swapper/206:41:132
1351199514,28cyclictest0-21swapper/205:46:252
1351199513,41cyclictest16274-21cpu05:51:052
13511995120,13cyclictest0-21swapper/210:31:022
1350999514,29cyclictest0-21swapper/007:55:580
13509995135,11cyclictest0-21swapper/006:45:480
219499500,5rtkit-daemon2193-21rtkit-daemon06:21:210
1351199504,27cyclictest0-21swapper/207:01:462
13511995018,14cyclictest0-21swapper/207:31:112
1350999494,37cyclictest0-21swapper/007:01:180
132142494,6sleep10-21swapper/105:42:301
13511994825,15cyclictest0-21swapper/207:06:122
134432444,33sleep20-21swapper/205:45:282
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional