You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-05 - 08:01

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rackcslot7s.osadl.org (updated Mon Jan 05, 2026 00:44:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
9128302930,7sleep04497-21PK-Backend23:40:150
81695628566,13sleep30-21swapper/319:05:463
197399830,63rtkit-daemon0-21swapper/119:05:281
197399770,5rtkit-daemon0-21swapper/022:12:450
197399760,6rtkit-daemon0-21swapper/022:48:560
197399760,5rtkit-daemon0-21swapper/021:56:130
197399750,8rtkit-daemon817419-21cyclictest20:11:080
197399750,6rtkit-daemon0-21swapper/019:16:070
197399750,5rtkit-daemon0-21swapper/019:55:550
197399750,5rtkit-daemon0-21swapper/000:10:370
81658827045,17sleep20-21swapper/219:05:252
81743199671,40cyclictest854418-21taskset20:54:132
81743199671,40cyclictest824723-21taskset19:29:342
81743199671,38cyclictest931711-21taskset00:32:172
81725626738,23sleep00-21swapper/019:09:360
81743199661,39cyclictest829922-21taskset19:44:382
81743199641,39cyclictest907005-21taskset23:24:202
81743199641,39cyclictest907005-21taskset23:24:202
81743199631,56cyclictest839842-21grep20:10:242
817431996214,42cyclictest890220-21expr22:35:152
81743199621,36cyclictest849951-21taskset20:40:172
817431996121,34cyclictest438-20systemd-journal23:27:152
81743199601,45cyclictest0-21swapper/222:17:072
81743199601,38cyclictest918811-21taskset23:55:302
81743199601,36cyclictest905119-21taskset23:17:192
81743199601,36cyclictest886026-21taskset22:22:192
81743199601,33cyclictest868894-21cat21:35:162
81743199581,51cyclictest923915-21sed00:10:302
81743199571,51cyclictest881634-21cat22:10:172
8792222560,18sleep013-21ksoftirqd/022:05:010
817431995623,29cyclictest934110-21systemd-run00:40:012
197399560,5rtkit-daemon0-21swapper/020:07:070
817431995519,31cyclictest844749-21sh20:25:162
817431995518,32cyclictest874513-21sort21:50:202
817431995518,32cyclictest874513-21sort21:50:202
817431995518,32cyclictest841327-21smartctl20:15:232
817431995517,33cyclictest842910-21expr20:20:162
81743199551,49cyclictest846882-21open_inodes20:30:272
81743199551,48cyclictest873840-21latency_hist21:50:022
81743599542,46cyclictest909479-21hddtemp_smartct23:30:183
81743199542,46cyclictest886494-21/usr/sbin/munin22:25:262
817431995422,28cyclictest866853-21/usr/sbin/munin21:30:172
817431995418,31cyclictest826694-21date19:35:022
817431995417,32cyclictest830492-21expr19:45:122
81743199541,48cyclictest899494-21wc23:00:282
81743599531,17cyclictest906096-21/usr/sbin/munin23:20:223
81743599531,17cyclictest906096-21/usr/sbin/munin23:20:223
81743199532,45cyclictest928683-21/usr/sbin/munin00:25:162
817431995316,32cyclictest870957-21cat21:40:152
81743199531,47cyclictest893458-21/usr/sbin/munin22:45:322
81743199531,47cyclictest876700-21python321:55:282
81743199531,47cyclictest836544-21grep20:00:282
81742599538,6cyclictest141rcu_preempt00:20:000
817435995225,23cyclictest850250-21needreboot20:40:243
817435995219,28cyclictest843640-21grep20:20:323
81743599521,16cyclictest862061-21/usr/sbin/munin21:15:173
81743199522,45cyclictest877935-21df_inode22:00:162
81743199522,45cyclictest856468-21/usr/sbin/munin21:00:142
817431995217,30cyclictest879473-21cpuspeed_turbos22:05:132
817431995216,32cyclictest851575-21expr20:45:132
817431995216,32cyclictest851575-21expr20:45:132
817431995216,31cyclictest902209-21cpuspeed23:10:172
817431995215,33cyclictest919800-21expr00:00:172
817431995215,32cyclictest911618-21processes23:35:262
81743199521,46cyclictest900636-21cstates23:05:152
81743199521,46cyclictest865997-21ps21:25:262
81743199521,45cyclictest892820-21systemd-udevd22:40:362
817431995213,34cyclictest916111-21cat23:50:132
81743599512,44cyclictest867316-21if_enp2s021:30:203
81743599512,12cyclictest915748-21perf23:49:593
81743599512,12cyclictest915748-21perf23:49:593
817435995117,30cyclictest923-21dbus-daemon22:20:013
817435995114,32cyclictest880918-21date22:10:013
817435995114,32cyclictest873009-21cat21:45:213
81743199512,44cyclictest928039-21sshd00:23:292
817431995118,28cyclictest913088-21latency23:40:232
817431995116,31cyclictest914384-21cat23:45:142
817431995116,31cyclictest914384-21cat23:45:142
817431995116,30cyclictest847818-21acpi20:35:112
81743199511,45cyclictest925227-21expr00:15:162
817431995114,32cyclictest858521-21expr21:05:192
817431995114,32cyclictest833914-21expr19:55:162
81743599507,8cyclictest913068-21expr23:40:233
81743599502,8cyclictest931871-21systemd-udevd00:34:163
81743599502,42cyclictest844775-21hddtemp_smartct20:25:193
817435995018,28cyclictest933369-21ntp_states00:35:273
817435995016,30cyclictest848035-21cpuspeed_turbos20:35:133
81743599501,44cyclictest893846-21df22:45:163
817435995010,11cyclictest869065-21if_err_enp2s021:35:213
81743199501,45cyclictest861931-21expr21:15:142
81743199501,45cyclictest0-21swapper/222:50:142
81743199501,44cyclictest1137-21runrttasks19:35:032
81743199501,43cyclictest860215-21expr21:10:142
817431995014,31cyclictest922024-21processes00:05:272
817431995012,33cyclictest837567-21cat20:05:142
817431995010,35cyclictest897202-21cat22:55:122
817431995010,35cyclictest897202-21cat22:55:122
81743599492,9cyclictest882433-40lsb_release22:11:003
817435994921,23cyclictest42-21ksoftirqd/320:55:293
817435994916,28cyclictest898742-21awk23:00:133
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional