You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-06 - 23:14

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Sat Dec 06, 2025 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
970021320,5sleep39702-21grep08:06:123
152762690,6sleep315415-21cpuspeed_turbos08:20:523
1675996513,25cyclictest15229-21munin-node10:35:463
1673996538,12cyclictest0-21swapper/107:17:481
1673996434,13cyclictest0-21swapper/111:40:571
1673996434,12cyclictest0-21swapper/107:06:081
167399643,50cyclictest0-21swapper/110:11:021
1673996236,7cyclictest18334-21munin-run11:50:281
1673996236,7cyclictest18334-21munin-run11:50:281
1673996134,12cyclictest0-21swapper/111:09:291
1673996134,12cyclictest0-21swapper/111:09:291
1673996036,9cyclictest23830-21nscd10:10:311
256002595,7sleep00-21swapper/010:55:540
177512582,11sleep30-21swapper/309:31:053
167599584,14cyclictest0-21swapper/312:00:413
167599581,11cyclictest0-21swapper/308:45:533
1674995814,37cyclictest0-21swapper/211:35:462
1673995834,10cyclictest0-21swapper/108:25:571
1673995833,10cyclictest0-21swapper/109:10:481
1673995829,11cyclictest0-21swapper/111:11:051
243799570,6rtkit-daemon2436-21rtkit-daemon11:15:500
243799570,4rtkit-daemon2436-21rtkit-daemon11:33:040
167499573,12cyclictest0-21swapper/211:40:422
1673995732,10cyclictest0-21swapper/110:40:531
1673995730,10cyclictest6781-21munin-node06:56:041
1673995730,10cyclictest6781-21munin-node06:56:041
54702563,8sleep15499-21sh10:15:451
296132564,45sleep20-21swapper/209:56:032
243799560,6rtkit-daemon2436-21rtkit-daemon12:00:480
243799560,5rtkit-daemon2436-21rtkit-daemon09:40:310
167599563,12cyclictest0-21swapper/308:40:483
167499565,43cyclictest989-21dbus-daemon10:45:302
167499563,46cyclictest30664-21munin-node07:45:542
167499563,44cyclictest9163-21munin-node07:01:072
167499563,44cyclictest1243-21snmpd10:04:162
167399565,44cyclictest0-21swapper/112:05:271
167399565,35cyclictest11165-21awk11:35:281
1673995632,9cyclictest20571-21fschecks_time08:30:551
1673995630,12cyclictest0-21swapper/108:59:051
1673995629,12cyclictest0-21swapper/109:16:021
1673995628,12cyclictest4396-21munin-node06:51:071
1673995628,12cyclictest0-21swapper/108:50:471
1673995625,13cyclictest0-21swapper/107:40:381
243799550,6rtkit-daemon2436-21rtkit-daemon07:50:500
243799550,5rtkit-daemon2436-21rtkit-daemon10:20:590
243799550,5rtkit-daemon2436-21rtkit-daemon08:26:490
215272554,43sleep20-21swapper/208:31:112
167599554,10cyclictest15265-21rt-features09:26:023
167599553,44cyclictest1243-21snmpd11:09:293
167599553,44cyclictest1243-21snmpd11:09:293
167599553,12cyclictest0-21swapper/309:55:543
167499554,44cyclictest4898-21sshd10:11:152
167499554,24cyclictest0-21swapper/209:26:072
167499554,11cyclictest0-21swapper/208:00:582
167499553,9cyclictest0-21swapper/212:06:012
167499553,12cyclictest0-21swapper/206:55:572
167499553,12cyclictest0-21swapper/206:55:572
1673995529,11cyclictest0-21swapper/109:06:071
1673995528,12cyclictest0-21swapper/108:16:101
167199553,13cyclictest0-21swapper/008:39:480
26422543,7sleep12743-21munin-node11:15:501
243799540,6rtkit-daemon2436-21rtkit-daemon10:36:060
243799540,5rtkit-daemon2436-21rtkit-daemon10:30:510
243799540,5rtkit-daemon2436-21rtkit-daemon10:25:440
243799540,5rtkit-daemon2436-21rtkit-daemon10:25:440
243799540,5rtkit-daemon2436-21rtkit-daemon09:56:000
243799540,5rtkit-daemon2436-21rtkit-daemon09:01:100
243799540,5rtkit-daemon2436-21rtkit-daemon09:01:100
243799540,5rtkit-daemon2436-21rtkit-daemon08:45:550
243799540,5rtkit-daemon2436-21rtkit-daemon08:40:560
167599544,41cyclictest6897-21runrttasks10:16:033
167599543,9cyclictest10497-21rt-features09:16:043
167599543,44cyclictest9163-21munin-node07:01:063
167599543,44cyclictest28273-21munin-node07:41:033
167599542,45cyclictest1810-21munin-node09:00:533
167599542,45cyclictest1810-21munin-node09:00:533
167499544,12cyclictest0-21swapper/210:56:002
167499543,12cyclictest0-21swapper/207:21:072
167399544,30cyclictest0-21swapper/106:50:391
1673995430,10cyclictest0-21swapper/107:45:391
1673995426,12cyclictest0-21swapper/109:36:061
139822544,42sleep10-21swapper/110:31:051
105022542,9sleep20-21swapper/209:16:052
54992532,45sleep00-21swapper/006:51:040
243799530,5rtkit-daemon2436-21rtkit-daemon11:57:480
243799530,5rtkit-daemon2436-21rtkit-daemon11:50:480
243799530,5rtkit-daemon2436-21rtkit-daemon09:30:540
243799530,5rtkit-daemon2436-21rtkit-daemon08:10:570
167599534,42cyclictest1243-21snmpd06:53:443
1675995338,10cyclictest18357-21gltestperf08:26:003
167599533,43cyclictest1243-21snmpd10:54:263
167599532,42cyclictest1243-21snmpd12:09:383
167599531,12cyclictest0-21swapper/310:55:483
167499535,29cyclictest0-21swapper/207:40:492
167499533,12cyclictest0-21swapper/211:16:042
167499533,12cyclictest0-21swapper/207:16:002
167499532,12cyclictest0-21swapper/207:36:122
1674995310,23cyclictest0-21swapper/208:50:482
167399534,31cyclictest0-21swapper/110:40:311
1673995326,12cyclictest0-21swapper/108:10:371
1673995324,13cyclictest0-21swapper/111:20:571
1673995323,12cyclictest0-21swapper/110:55:311
28182523,42sleep31185-21sshd10:10:153
243799520,5rtkit-daemon2436-21rtkit-daemon12:11:170
243799520,5rtkit-daemon2436-21rtkit-daemon12:06:030
243799520,5rtkit-daemon2436-21rtkit-daemon11:40:490
243799520,5rtkit-daemon2436-21rtkit-daemon11:20:570
243799520,5rtkit-daemon2436-21rtkit-daemon10:15:520
243799520,5rtkit-daemon2436-21rtkit-daemon09:45:460
243799520,5rtkit-daemon2436-21rtkit-daemon09:45:460
243799520,5rtkit-daemon2436-21rtkit-daemon08:05:570
243799520,5rtkit-daemon2436-21rtkit-daemon07:58:200
243799520,5rtkit-daemon2436-21rtkit-daemon07:33:210
219152523,9sleep30-21swapper/308:34:313
167599524,41cyclictest523-21cat07:50:383
167599523,43cyclictest1243-21snmpd10:42:133
167599523,42cyclictest18654-21telnet11:50:403
167599522,10cyclictest0-21swapper/311:21:063
167499525,28cyclictest0-21swapper/208:36:072
1674995232,12cyclictest13493-21gltestperf10:30:552
167499523,43cyclictest1243-21snmpd09:04:062
167499523,43cyclictest1243-21snmpd09:04:062
167499523,12cyclictest0-21swapper/210:06:032
167499523,10cyclictest0-21swapper/211:25:292
167499522,11cyclictest0-21swapper/207:31:142
167399525,28cyclictest0-21swapper/109:45:521
167399525,28cyclictest0-21swapper/109:45:521
167399525,28cyclictest0-21swapper/107:23:481
167399525,27cyclictest0-21swapper/108:40:361
1673995229,10cyclictest0-21swapper/107:45:471
1673995227,12cyclictest0-21swapper/108:13:241
1673995227,11cyclictest0-21swapper/108:49:031
1673995226,11cyclictest0-21swapper/110:55:531
1673995224,13cyclictest0-21swapper/107:51:101
1673995224,10cyclictest30587-21munin-node10:01:071
1673995223,13cyclictest0-21swapper/107:26:021
1673995221,13cyclictest0-21swapper/112:10:261
51422513,40sleep20-21swapper/207:58:302
243799510,5rtkit-daemon2436-21rtkit-daemon11:36:040
243799510,5rtkit-daemon2436-21rtkit-daemon10:06:000
243799510,5rtkit-daemon2436-21rtkit-daemon09:15:540
167599513,42cyclictest1243-21snmpd09:36:333
167599512,24cyclictest14772-21crond10:35:313
167499516,39cyclictest0-21swapper/208:15:572
167499516,29cyclictest0-21swapper/208:13:572
167499515,28cyclictest0-21swapper/211:45:452
167499515,28cyclictest0-21swapper/211:45:452
167499514,10cyclictest29549-21sendmail_mailqu12:11:142
1674995135,10cyclictest5602-21needreboot06:51:042
167499513,40cyclictest1243-21snmpd10:39:232
167499513,11cyclictest0-21swapper/208:56:082
167499513,10cyclictest0-21swapper/209:41:022
1674995121,13cyclictest0-21swapper/211:04:282
1674995117,13cyclictest0-21swapper/211:59:362
167399515,29cyclictest0-21swapper/108:01:001
167399515,28cyclictest0-21swapper/109:00:541
167399515,28cyclictest0-21swapper/109:00:541
167399515,27cyclictest0-21swapper/111:50:471
167399514,28cyclictest0-21swapper/111:05:291
167399514,27cyclictest0-21swapper/109:25:341
167399514,26cyclictest0-21swapper/108:41:371
167399513,28cyclictest0-21swapper/110:45:481
1673995128,10cyclictest0-21swapper/111:58:011
1673995127,12cyclictest0-21swapper/107:11:271
1673995126,12cyclictest0-21swapper/107:00:481
1673995125,11cyclictest0-21swapper/110:25:341
1673995125,11cyclictest0-21swapper/110:25:341
1673995120,13cyclictest0-21swapper/110:20:481
1673995119,14cyclictest0-21swapper/108:23:591
1673995118,14cyclictest0-21swapper/107:30:551
314682502,9sleep20-21swapper/211:10:112
314682502,9sleep20-21swapper/211:10:112
26732502,9sleep20-21swapper/207:52:252
243799500,5rtkit-daemon2436-21rtkit-daemon11:11:420
243799500,5rtkit-daemon2436-21rtkit-daemon11:05:420
243799500,5rtkit-daemon2436-21rtkit-daemon11:05:420
243799500,5rtkit-daemon2436-21rtkit-daemon09:40:460
243799500,4rtkit-daemon2436-21rtkit-daemon09:10:540
212122504,12sleep20-21swapper/210:46:012
167599504,40cyclictest0-21swapper/309:10:473
167599503,9cyclictest683-21rt-features11:11:003
167599503,41cyclictest16924-21fschecks_time11:45:463
167599503,41cyclictest16924-21fschecks_time11:45:463
167599503,29cyclictest0-21swapper/307:50:513
167599502,8cyclictest27218-21rt-features09:51:023
167599502,10cyclictest0-21swapper/308:35:483
167599502,10cyclictest0-21swapper/307:21:033
1675995018,12cyclictest0-21swapper/308:16:043
167499506,28cyclictest0-21swapper/209:05:522
1674995033,11cyclictest11944-21unixbench_multi10:26:062
1674995033,11cyclictest11944-21unixbench_multi10:26:062
167499503,41cyclictest24340-21latency_hist10:55:302
1674995020,13cyclictest0-21swapper/208:45:532
167499502,11cyclictest0-21swapper/210:21:042
167499502,11cyclictest0-21swapper/206:49:012
1674995017,13cyclictest0-21swapper/209:30:462
167399505,28cyclictest0-21swapper/111:35:551
167399505,28cyclictest0-21swapper/109:25:491
167399505,27cyclictest0-21swapper/111:29:321
167399504,28cyclictest0-21swapper/108:00:371
167399504,26cyclictest16243-21munin-node09:30:491
1673995026,11cyclictest0-21swapper/109:41:291
1673995025,11cyclictest0-21swapper/109:51:011
167199503,40cyclictest30556-21kworker/u8:107:01:020
133012503,9sleep30-21swapper/311:37:163
243799490,5rtkit-daemon2436-21rtkit-daemon10:50:430
243799490,5rtkit-daemon2436-21rtkit-daemon10:11:070
243799490,4rtkit-daemon2436-21rtkit-daemon11:01:050
167599494,38cyclictest6637-21aten2.4-expect11:25:403
167599494,37cyclictest28286-21telnet12:10:573
167599494,12cyclictest0-21swapper/308:02:303
1675994934,9cyclictest23769-21tr09:45:473
1675994934,9cyclictest23769-21tr09:45:473
167599493,40cyclictest10873-21df_abs08:10:523
167599493,39cyclictest11670-21aten_r1power_po07:05:533
167499495,38cyclictest0-21swapper/211:25:412
1674994930,12cyclictest6331-21sed10:15:532
167499492,10cyclictest0-21swapper/209:35:592
167499492,10cyclictest0-21swapper/208:45:362
1674994918,15cyclictest0-21swapper/212:00:412
1673994929,11cyclictest29890-21unixbench_singl12:11:181
1673994924,12cyclictest0-21swapper/109:55:451
136112492,40sleep30-21swapper/309:25:293
135922492,9sleep20-21swapper/207:09:202
96772482,40sleep30-21swapper/310:21:233
87832483,9sleep30-21swapper/306:58:493
87832483,9sleep30-21swapper/306:58:493
86182482,39sleep20-21swapper/209:12:342
64152483,9sleep30-21swapper/309:09:573
323452485,7sleep00-21swapper/007:46:110
228162482,39sleep30-21swapper/311:56:553
217682483,37sleep00-21swapper/010:48:130
194352484,9sleep00-21swapper/010:43:530
18932483,9sleep30-21swapper/306:45:513
170392482,39sleep00-21swapper/008:23:070
167599484,38cyclictest0-21swapper/307:16:113
167599483,38cyclictest30615-21telnet10:00:453
167499485,36cyclictest23486-21telnet09:45:452
167499485,36cyclictest23486-21telnet09:45:452
167499484,28cyclictest0-21swapper/209:50:562
167499483,37cyclictest15116-21telnet08:20:492
167499483,28cyclictest0-21swapper/209:20:452
1674994817,13cyclictest0-21swapper/208:08:562
167199483,40cyclictest0-21swapper/008:15:510
1671994829,9cyclictest0-21swapper/007:15:170
1671994829,7cyclictest28044-21latency_hist07:40:390
1671994824,10cyclictest20854-21crond07:25:380
13872482,9sleep20-21swapper/211:14:302
62052472,37sleep00-21swapper/009:07:120
322142478,29sleep20-21swapper/206:40:562
277052472,9sleep00-21swapper/009:52:140
230112472,9sleep30-21swapper/309:43:193
167599474,27cyclictest0-21swapper/311:15:583
167599474,23cyclictest28014-21yum-updatesd-he07:40:383
1675994732,10cyclictest3453-21tr10:10:473
1675994725,17cyclictest1369-21runrttasks07:31:103
167499473,9cyclictest19070-21timerwakeupswit08:26:122
167499473,16cyclictest0-21swapper/207:11:052
167499472,41cyclictest0-21swapper/211:53:072
167499472,11cyclictest0-21swapper/211:34:012
167199475,35cyclictest0-21swapper/007:20:390
167199473,37cyclictest0-21swapper/007:40:540
1671994727,8cyclictest19858-21munin-node08:30:590
1671994723,8cyclictest18327-21latency_hist11:50:280
1671994723,8cyclictest18327-21latency_hist11:50:280
1671994723,11cyclictest6613-21munin-node11:25:590
1671994721,12cyclictest0-21swapper/008:00:570
110462472,9sleep30-21swapper/311:34:143
167599463,37cyclictest0-21swapper/311:01:083
167499464,26cyclictest0-21swapper/207:25:582
167199465,35cyclictest0-21swapper/007:05:520
1671994620,12cyclictest0-21swapper/008:50:520
13812464,36sleep00-21swapper/006:42:270
167599455,34cyclictest15947-21awk11:45:283
1675994529,11cyclictest21406-21cpuspeed_turbos07:25:533
167599452,25cyclictest15775-21taskset07:11:383
167599452,25cyclictest0-21swapper/310:45:443
167599443,35cyclictest0-21swapper/307:55:523
167599443,26cyclictest0-21swapper/308:51:043
1671994421,10cyclictest0-21swapper/006:47:000
326942432,35sleep00-21swapper/010:05:040
167599434,31cyclictest31852-21telnet08:55:453
167599433,23cyclictest11825-21sed10:26:053
167599433,23cyclictest11825-21sed10:26:053
167399435,13cyclictest0-21swapper/106:45:401
167199433,35cyclictest0-21swapper/007:26:130
158762432,36sleep00-21swapper/009:28:530
243799420,4rtkit-daemon2436-21rtkit-daemon09:24:090
167199423,34cyclictest0-21swapper/006:55:450
167199423,34cyclictest0-21swapper/006:55:450
243799410,4rtkit-daemon2436-21rtkit-daemon08:55:480
1675993710,22cyclictest1748-21latency_hist06:45:403
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional