You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-28 - 16:40

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot6s.osadl.org (updated Mon Sep 28, 2026 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2194991290,6rtkit-daemon0-21swapper/108:12:080
2194991290,5rtkit-daemon0-21swapper/007:56:241
2194991230,8rtkit-daemon0-21swapper/005:49:511
2194991180,5rtkit-daemon0-21swapper/009:32:351
2194991140,6rtkit-daemon0-21swapper/009:08:591
25804991064,11cyclictest23902-21unixbench_multi07:20:200
25804991045,16cyclictest0-21swapper/008:52:200
258049910019,10cyclictest25813-21ssh10:39:580
258049910010,23cyclictest18546-21diskmemload09:40:150
2580499985,87cyclictest1227-21runrttasks06:59:570
2580499984,87cyclictest0-21swapper/010:33:180
275062970,2sleep1201ktimersoftd/110:42:091
2580699973,9cyclictest8428-21ssh07:45:162
2580499976,84cyclictest0-21swapper/010:06:150
2580499974,25cyclictest0-21swapper/009:49:390
2580699964,67cyclictest0-21swapper/208:35:072
2580499968,25cyclictest0-21swapper/007:40:510
2580499964,29cyclictest0-21swapper/009:30:040
2580499964,13cyclictest0-21swapper/006:15:110
2580499964,13cyclictest0-21swapper/006:15:110
2580699954,68cyclictest0-21swapper/208:28:572
2580699954,12cyclictest0-21swapper/209:06:492
25806999518,64cyclictest1556-21nscd10:29:392
2580499955,13cyclictest0-21swapper/009:34:440
2580499955,13cyclictest0-21swapper/009:34:440
2580499954,65cyclictest0-21swapper/008:58:570
2580499954,14cyclictest0-21swapper/010:19:110
2580699944,9cyclictest16505-21ssh07:59:402
2580699944,14cyclictest0-21swapper/207:16:442
2580699944,13cyclictest0-21swapper/207:35:002
2580699943,10cyclictest4870-21fschecks_count08:30:012
2580499944,68cyclictest0-21swapper/007:55:050
2580499943,10cyclictest0-21swapper/009:25:270
25805999310,75cyclictest0-21swapper/107:20:181
2580499935,29cyclictest0-21swapper/008:35:060
2580499934,83cyclictest0-21swapper/007:29:460
2580499934,25cyclictest1227-21runrttasks08:34:060
2580499934,25cyclictest0-21swapper/009:19:570
2580499934,24cyclictest18546-21diskmemload09:55:080
2580499933,10cyclictest0-21swapper/007:05:000
25804999318,12cyclictest0-21swapper/008:45:320
25804999311,21cyclictest28979-21grep09:05:140
219499930,7rtkit-daemon0-21swapper/010:01:410
25806999210,11cyclictest0-21swapper/207:28:532
2580499925,74cyclictest0-21swapper/010:35:520
219499920,6rtkit-daemon0-21swapper/010:13:260
2580699915,63cyclictest0-21swapper/209:23:042
2580699914,14cyclictest0-21swapper/207:23:362
2580699913,13cyclictest15623-21swap08:45:142
25806999116,52cyclictest1080-21lldpd09:15:332
25806999114,62cyclictest0-21swapper/210:30:132
2580499919,24cyclictest0-21swapper/007:30:200
2580499915,75cyclictest25103-21latency09:00:060
2580499915,27cyclictest0-21swapper/007:50:200
2580499913,28cyclictest0-21swapper/009:15:140
25804999117,13cyclictest0-21swapper/010:25:110
2580699904,9cyclictest27004-21kworker/2:009:30:042
2580699904,64cyclictest0-21swapper/208:16:352
2580699904,64cyclictest0-21swapper/208:16:352
2580699904,14cyclictest0-21swapper/209:00:162
2580699903,10cyclictest3036-21munin-node10:04:592
2580499905,16cyclictest0-21swapper/008:20:080
2580499904,78cyclictest0-21swapper/010:23:580
2580499904,78cyclictest0-21swapper/006:30:110
2580499904,29cyclictest0-21swapper/009:49:570
2580499904,28cyclictest0-21swapper/008:15:080
2580499904,28cyclictest0-21swapper/008:15:080
2580499903,10cyclictest32355-21unixbench_singl09:10:150
2580699895,66cyclictest0-21swapper/209:29:382
2580699894,14cyclictest0-21swapper/207:39:582
2580699893,9cyclictest12341-21ssh07:51:182
2580499896,13cyclictest0-21swapper/005:15:040
2580499894,75cyclictest19453-21grep07:15:050
25804998920,12cyclictest0-21swapper/008:41:350
219499890,4rtkit-daemon2193-21rtkit-daemon05:15:082
278582880,5sleep227857-21cut06:25:072
2580699884,63cyclictest0-21swapper/208:40:392
2580699884,62cyclictest0-21swapper/209:47:122
2580699884,13cyclictest0-21swapper/208:55:102
2580699884,12cyclictest0-21swapper/207:00:192
2580699883,9cyclictest27970-21ssh09:54:512
2580699883,65cyclictest25710-21ssh09:50:042
2580699883,63cyclictest0-21swapper/208:01:142
2580699883,62cyclictest15002-21ssh10:24:372
2580699883,60cyclictest22910-21ssh10:35:012
2580599884,75cyclictest0-21swapper/107:40:231
2580599883,77cyclictest14740-21fschecks_time07:05:051
2580499885,24cyclictest0-21swapper/008:05:360
2580499884,26cyclictest0-21swapper/007:10:000
2580499884,25cyclictest0-21swapper/007:49:100
2580699875,69cyclictest0-21swapper/209:40:062
2580699874,14cyclictest0-21swapper/206:05:082
2580699873,9cyclictest1124-21snmpd06:50:092
25806998719,45cyclictest0-21swapper/205:55:072
2580499874,76cyclictest0-21swapper/007:35:020
2580499873,25cyclictest0-21swapper/005:50:010
219499870,7rtkit-daemon0-21swapper/006:20:130
2580699864,9cyclictest17897-21ls09:39:422
2580699864,9cyclictest17897-21ls09:39:422
2580699864,14cyclictest0-21swapper/205:33:262
2580699864,14cyclictest0-21swapper/205:33:262
2580699864,13cyclictest0-21swapper/210:42:232
2580699863,61cyclictest20215-21kworker/2:208:14:452
25806998614,50cyclictest0-21swapper/210:10:002
2580599862,77cyclictest21384-21ssh10:33:531
2580499864,75cyclictest0-21swapper/005:20:170
219499860,5rtkit-daemon0-21swapper/108:13:161
2580699854,67cyclictest0-21swapper/208:21:552
2580699854,61cyclictest0-21swapper/210:04:122
2580699854,15cyclictest0-21swapper/206:49:482
2580699854,14cyclictest0-21swapper/210:19:072
2580699854,13cyclictest0-21swapper/206:00:122
2580699853,60cyclictest0-21swapper/208:08:132
2580699853,11cyclictest0-21swapper/205:45:202
2580599855,73cyclictest0-21swapper/107:18:491
2580599854,72cyclictest0-21swapper/109:25:001
2580599853,75cyclictest22973-21sed10:35:021
2580599853,75cyclictest0-21swapper/108:30:131
2580599853,74cyclictest20765-21fschecks_count08:05:021
2580599853,73cyclictest25419-21gltestperf09:49:591
2580499859,10cyclictest107550irq/46-eth008:00:040
2580499854,74cyclictest0-21swapper/006:35:050
2580499854,73cyclictest0-21swapper/006:05:150
2580499854,26cyclictest0-21swapper/006:13:330
2580499854,21cyclictest1823-21idleruntime08:25:050
219499850,6rtkit-daemon0-21swapper/107:33:171
2580699844,12cyclictest0-21swapper/209:09:482
2580699844,12cyclictest0-21swapper/207:32:222
2580699843,66cyclictest0-21swapper/208:51:242
2580599843,72cyclictest15913-21ssh09:35:081
2580599843,72cyclictest15913-21ssh09:35:081
2580499844,73cyclictest0-21swapper/006:49:490
2580699834,55cyclictest0-21swapper/205:50:132
2580699834,14cyclictest0-21swapper/206:15:122
2580699834,14cyclictest0-21swapper/206:15:122
2580699834,13cyclictest0-21swapper/205:25:082
2580599838,44cyclictest0-21swapper/110:23:581
2580599834,73cyclictest0-21swapper/105:20:161
2580599834,47cyclictest0-21swapper/109:49:411
2580599833,72cyclictest8312-21rm07:45:141
25804998328,49cyclictest6491-21tail05:40:100
219499830,6rtkit-daemon0-21swapper/107:02:261
2580699824,56cyclictest0-21swapper/206:58:322
2580699824,56cyclictest0-21swapper/206:58:322
2580699824,13cyclictest0-21swapper/205:20:222
25806998219,48cyclictest0-21swapper/205:43:282
2580599825,70cyclictest0-21swapper/110:05:581
2580599825,70cyclictest0-21swapper/109:59:391
2580599824,71cyclictest0-21swapper/110:25:011
2580599824,71cyclictest0-21swapper/108:58:001
2580599824,71cyclictest0-21swapper/108:49:461
2580599824,71cyclictest0-21swapper/108:36:031
2580599824,71cyclictest0-21swapper/108:26:121
2580599823,72cyclictest8784-21taskset06:52:201
2580599823,72cyclictest28801-21cat07:29:461
2580599823,72cyclictest18546-21diskmemload08:03:011
2580599823,70cyclictest30793-21munin-node05:25:231
2580599823,58cyclictest0-21swapper/108:20:121
2580499825,68cyclictest0-21swapper/006:00:150
2580499824,13cyclictest0-21swapper/005:28:250
25804998226,47cyclictest9778-21tail05:45:210
25804998224,51cyclictest0-21swapper/005:35:200
2580699818,9cyclictest7150irq/45-ahci06:35:082
2580699814,14cyclictest0-21swapper/206:10:032
2580599815,70cyclictest0-21swapper/108:45:071
2580599814,70cyclictest0-21swapper/105:40:211
2580599814,69cyclictest11486-21needreboot07:50:141
2580599814,69cyclictest0-21swapper/110:00:301
2580599814,49cyclictest0-21swapper/109:44:221
2580599813,71cyclictest24783-21munin-node06:20:201
2580599813,71cyclictest1755-21grep07:35:181
2580599813,71cyclictest0-21swapper/105:19:511
2580599813,70cyclictest1493-21tail09:14:551
2580599813,45cyclictest0-21swapper/106:30:061
2580499814,25cyclictest0-21swapper/005:55:020
2580699804,13cyclictest0-21swapper/207:10:172
2580699804,13cyclictest0-21swapper/206:40:192
2580599804,68cyclictest0-21swapper/109:11:331
2580599803,70cyclictest6055-21missed_timers09:20:061
2580599803,69cyclictest27063-21cstates08:14:571
2580599803,69cyclictest27063-21cstates08:14:571
2580599803,69cyclictest0-21swapper/105:55:201
2580499806,13cyclictest1227-21runrttasks06:52:480
2580499804,70cyclictest0-21swapper/005:30:070
2580499804,70cyclictest0-21swapper/005:30:070
2580699794,59cyclictest0-21swapper/206:31:092
2580599794,68cyclictest0-21swapper/108:39:441
2580599793,69cyclictest24554-21munin-node08:59:591
2580599793,69cyclictest15789-21df06:00:051
2580599793,68cyclictest8964-21cpuspeed10:14:521
2580599783,67cyclictest9434-21munin-node06:54:591
2580599783,67cyclictest9434-21munin-node06:54:591
2580599782,69cyclictest3048-21sshd06:40:101
2580499783,21cyclictest11241-21seq06:58:100
2580499783,21cyclictest11241-21seq06:58:100
25804997815,17cyclictest0-21swapper/006:25:170
2580699774,57cyclictest0-21swapper/207:05:022
2580699774,14cyclictest0-21swapper/205:35:232
2580699774,13cyclictest0-21swapper/206:20:022
2580599773,67cyclictest10479-21munin-node05:50:001
2580599773,67cyclictest0-21swapper/110:09:521
2580599773,66cyclictest19287-21runrttasks06:05:221
2580599773,66cyclictest1124-21snmpd06:48:391
25804997723,10cyclictest2090-21aten_r1power_fr06:40:000
219499760,8rtkit-daemon0-21swapper/008:40:153
219499760,7rtkit-daemon0-21swapper/007:13:031
2580599743,65cyclictest20069-21tail06:10:021
2580599743,64cyclictest0-21swapper/106:15:061
2580599743,64cyclictest0-21swapper/106:15:061
2580599743,64cyclictest0-21swapper/105:35:111
219499740,5rtkit-daemon0-21swapper/006:28:201
2580699734,12cyclictest0-21swapper/205:14:512
2580599734,62cyclictest0-21swapper/106:37:181
72712720,4sleep37272-21sh08:34:443
2580599703,60cyclictest1653-21cut05:30:111
2580599703,60cyclictest1653-21cut05:30:111
2580499704,24cyclictest0-21swapper/005:14:510
2580599684,57cyclictest0-21swapper/105:14:511
25807996516,11cyclictest0-21swapper/310:00:073
219499600,4rtkit-daemon28380-21taskset08:15:163
219499600,4rtkit-daemon28380-21taskset08:15:163
219499590,7rtkit-daemon0-21swapper/209:16:363
25807995813,27cyclictest0-21swapper/310:39:593
25807995738,11cyclictest8387-21cpuspeed_turbos05:45:023
25807995637,11cyclictest32263-21tr06:35:023
25807995637,11cyclictest16486-21tail09:35:173
25807995637,11cyclictest16486-21tail09:35:173
287022553,7sleep328709-21latency_hist07:29:463
2580799554,30cyclictest0-21swapper/306:10:113
25807995536,12cyclictest21559-21gltestperf08:55:013
25807995518,30cyclictest28493-21fschecks_count09:54:563
219499550,6rtkit-daemon2193-21rtkit-daemon10:23:183
2580799545,14cyclictest0-21swapper/308:04:433
2580799544,18cyclictest0-21swapper/308:24:483
25807995337,10cyclictest18939-21cpuspeed_turbos10:29:533
25807995323,13cyclictest0-21swapper/305:25:173
25807995320,13cyclictest0-21swapper/305:34:503
25807995320,13cyclictest0-21swapper/305:34:503
25807995313,20cyclictest6181-21unixbench_singl06:45:213
86712523,42sleep30-21swapper/306:50:533
302232523,42sleep30-21swapper/305:20:363
2580799524,30cyclictest0-21swapper/308:59:563
2580799524,13cyclictest0-21swapper/308:34:543
25807995222,10cyclictest7525-21diskstats07:45:033
25807995221,13cyclictest0-21swapper/305:15:093
2580799522,45cyclictest0-21swapper/308:07:523
25807995219,27cyclictest361ktimersoftd/307:35:023
219499520,6rtkit-daemon2193-21rtkit-daemon09:20:433
219499520,5rtkit-daemon2193-21rtkit-daemon09:04:593
2580799519,24cyclictest0-21swapper/310:25:143
2580799518,31cyclictest0-21swapper/310:37:013
2580799515,27cyclictest0-21swapper/307:40:033
2580799514,29cyclictest0-21swapper/306:05:153
2580799514,28cyclictest0-21swapper/307:15:043
2580799514,28cyclictest0-21swapper/306:29:583
25807995136,9cyclictest22203-21sh09:45:003
219499510,5rtkit-daemon2193-21rtkit-daemon08:14:313
2580799504,40cyclictest0-21swapper/310:16:333
2580799504,28cyclictest0-21swapper/310:10:053
2580799504,28cyclictest0-21swapper/309:40:143
2580799504,28cyclictest0-21swapper/309:10:023
2580799504,28cyclictest0-21swapper/307:00:143
2580799504,28cyclictest0-21swapper/306:40:153
2580799504,28cyclictest0-21swapper/306:15:123
2580799504,28cyclictest0-21swapper/306:15:123
2580799504,28cyclictest0-21swapper/305:35:273
2580799504,27cyclictest0-21swapper/308:20:093
2580799504,27cyclictest0-21swapper/307:34:463
2580799504,13cyclictest0-21swapper/309:52:023
2580799504,12cyclictest0-21swapper/306:28:363
25807995034,10cyclictest14546-21tail05:55:233
25807995032,11cyclictest22386-21ssh07:20:003
219499500,6rtkit-daemon2193-21rtkit-daemon05:10:083
161112503,10sleep30-21swapper/307:09:143
141232502,10sleep30-21swapper/309:33:343
124862502,13sleep30-21swapper/305:53:293
2580799495,25cyclictest0-21swapper/306:54:583
2580799495,25cyclictest0-21swapper/306:54:583
2580799494,28cyclictest0-21swapper/308:44:553
2580799494,27cyclictest0-21swapper/310:04:423
2580799494,27cyclictest0-21swapper/308:50:183
2580799494,27cyclictest0-21swapper/307:54:563
2580799484,28cyclictest0-21swapper/307:10:053
25807994819,12cyclictest0-21swapper/307:50:273
74792472,39sleep30-21swapper/305:40:273
2580799474,27cyclictest0-21swapper/309:24:453
2580799464,12cyclictest0-21swapper/306:00:043
25807994615,13cyclictest0-21swapper/306:20:133
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional