You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-19 - 21:56

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot3s.osadl.org (updated Fri Dec 19, 2025 12:45:01)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
8452059910317,4cyclictest131rcu_preempt08:00:023
8452059910317,4cyclictest131rcu_preempt08:00:023
845205998475,7cyclictest37-21ksoftirqd/311:50:023
845205997024,42cyclictest1-21systemd07:25:003
845205997020,45cyclictest847509-21sed07:55:023
845202997020,14cyclictest856842-21systemd-run10:55:012
84520599682,11cyclictest858101-21sshd11:19:143
84520599681,12cyclictest846642-21sshd07:35:143
84520599681,12cyclictest846642-21sshd07:35:143
845202996731,5cyclictest846439-21munin-run07:35:012
845205996318,39cyclictest275-21dbus-daemon09:40:003
845195996321,37cyclictest850825-21kworker/u8:309:00:010
84520599621,13cyclictest852665-21sshd09:33:143
84520599621,13cyclictest852665-21sshd09:33:133
84520599612,18cyclictest853954-21sshd09:59:443
84520599612,13cyclictest860932-21sshd12:11:163
845205996120,36cyclictest37-21ksoftirqd/309:10:013
84520599611,13cyclictest846968-21munin-run07:45:003
845202996146,11cyclictest851882-21sshd09:17:142
845202996143,13cyclictest849092-21munin-run08:25:012
84520599602,16cyclictest855783-21cron10:35:003
84520599602,13cyclictest856293-21sshd10:40:143
84520599602,13cyclictest856293-21sshd10:40:143
845205996013,9cyclictest857367-21sh11:05:003
84520599601,13cyclictest858619-21sshd11:26:143
84520599601,13cyclictest364-21snmpd10:17:043
845202996046,10cyclictest845606-21cron07:17:002
845202996042,14cyclictest850593-21sshd08:54:332
84520599592,11cyclictest847221-21munin-run07:50:013
84520599592,11cyclictest845687-21munin-run07:20:013
84520599591,17cyclictest850289-21latency_hist08:45:023
84520599591,14cyclictest857584-21sshd11:08:143
845205995910,4cyclictest0-21swapper/308:25:593
845202995946,9cyclictest860668-21cat12:05:022
845202995944,10cyclictest853197-21sshd09:44:142
845202995942,14cyclictest846653-21sshd07:38:152
845202995942,14cyclictest846653-21sshd07:38:152
845202995939,14cyclictest855782-21cron10:35:002
845195995936,18cyclictest275-21dbus-daemon07:20:000
84519599592,39cyclictest859272-21modprobe11:40:020
84520599583,15cyclictest856583-21modprobe10:50:003
84520599582,9cyclictest849566-21cron08:35:003
845205995822,32cyclictest845382-21latency_hist07:15:023
84520599581,13cyclictest861478-21sshd12:23:163
84520599581,12cyclictest364-21snmpd08:36:233
84520599581,11cyclictest853442-21sshd09:47:143
845202995844,10cyclictest861969-21sshd12:30:162
845202995844,10cyclictest852163-21sshd09:23:132
845202995842,13cyclictest861730-21sshd12:29:162
84519599585,14cyclictest852442-21munin-plugin-st09:30:000
84520599573,11cyclictest848459-21modprobe08:11:143
845205995725,29cyclictest860032-21latency_hist11:55:023
845205995725,29cyclictest37-21ksoftirqd/311:00:023
845205995725,29cyclictest37-21ksoftirqd/311:00:023
84520599572,16cyclictest850846-21cron09:00:013
84520599571,16cyclictest848208-21sshd08:06:143
845202995750,4cyclictest851650-21munin-run09:15:012
845202995744,10cyclictest853434-21sshd09:45:152
845202995744,10cyclictest845905-21sshd07:24:142
845202995744,10cyclictest364-21snmpd10:13:082
845202995743,10cyclictest856012-21sshd10:35:142
845202995742,12cyclictest848223-21sshd08:09:222
845202995740,14cyclictest364-21snmpd11:03:172
845202995732,20cyclictest238-21systemd-journal09:28:142
84520599563,49cyclictest855278-21cron10:25:003
84520599563,13cyclictest855562-21latency_hist10:30:023
84520599562,15cyclictest861760-21munin-run12:30:013
84520599562,13cyclictest848811-21munin-run08:20:013
845205995617,36cyclictest37-21ksoftirqd/308:55:013
845205995615,36cyclictest275-21dbus-daemon11:15:013
84520599561,14cyclictest364-21snmpd08:48:573
845205995611,4cyclictest0-21swapper/308:01:393
845202995644,8cyclictest850110-21munin-run08:45:002
845202995643,10cyclictest860678-21sshd12:05:152
845202995643,10cyclictest860678-21sshd12:05:142
845202995642,10cyclictest845386-21munin-run07:15:002
845202995641,12cyclictest846924-21sshd07:41:142
845202995641,11cyclictest857608-21munin-run11:10:002
84520599553,16cyclictest846426-21munin-run07:35:013
84520599552,9cyclictest670-21sendmail-mta09:44:243
84520599552,16cyclictest862000-21munin-run12:35:013
84520599552,12cyclictest851873-21cron09:17:003
845205995518,31cyclictest275-21dbus-daemon07:30:013
84520599551,12cyclictest364-21snmpd12:17:473
845202995542,10cyclictest850329-21sshd08:46:142
845202995541,10cyclictest849330-21munin-run08:30:002
845202995541,10cyclictest364-21snmpd10:28:102
845202995529,22cyclictest1-21systemd10:50:002
845195995543,7cyclictest16950irq/224-800000010:20:000
845195995530,17cyclictest275-21dbus-daemon08:20:010
84520599543,14cyclictest859429-21munin-run11:45:003
84520599542,18cyclictest854756-21modprobe10:15:013
84520599542,12cyclictest852157-21sshd09:21:143
84520599542,11cyclictest859190-21munin-run11:40:013
84520599542,11cyclictest854706-21latency_hist10:10:023
84520599541,15cyclictest858885-21cron11:35:003
84520599541,12cyclictest860461-21munin-plugin-st12:05:003
845202995443,8cyclictest846146-21sshd07:27:142
845202995441,10cyclictest852916-21sshd09:38:142
845202995440,10cyclictest858400-21munin-run11:25:002
845202995435,14cyclictest275-21dbus-daemon12:15:002
845195995429,21cyclictest275-21dbus-daemon10:45:010
845195995429,21cyclictest275-21dbus-daemon10:45:010
84520599534,11cyclictest238-21systemd-journal11:59:593
84520599532,11cyclictest364-21snmpd12:09:293
84520599532,11cyclictest364-21snmpd12:09:283
845205995312,4cyclictest852176-21cron09:25:023
84520599531,12cyclictest856879-21latency_hist10:55:013
845202995341,9cyclictest854476-21sshd10:08:142
845202995340,10cyclictest364-21snmpd11:48:262
845202995340,10cyclictest364-21snmpd11:33:232
845202995338,11cyclictest364-21snmpd11:18:212
845202995338,11cyclictest364-21snmpd09:07:552
845202995338,10cyclictest850848-21cron09:00:012
845202995336,13cyclictest364-21snmpd11:35:182
845202995336,13cyclictest364-21snmpd10:55:412
845202995336,13cyclictest364-21snmpd10:55:412
845202995335,14cyclictest851112-21sshd09:02:142
845202995334,15cyclictest364-21snmpd08:18:322
845202995333,14cyclictest849819-21cron08:40:012
845202995328,21cyclictest858625-21sshd11:28:142
84520599523,9cyclictest853848-21latency_hist09:55:023
84520599522,11cyclictest364-21snmpd11:22:153
845202995244,4cyclictest847459-21munin-run07:55:002
845202995243,6cyclictest853734-21munin-run09:55:012
845202995240,9cyclictest861475-21sshd12:22:172
845202995239,10cyclictest364-21snmpd08:32:502
845202995229,19cyclictest311-21rs:main2
84519599526,38cyclictest853971-21sh10:00:000
845195995237,10cyclictest856056-21grep10:40:000
845195995234,13cyclictest1-21systemd08:05:000
84520599511,12cyclictest364-21snmpd08:24:353
845202995139,9cyclictest364-21snmpd10:43:202
845202995139,9cyclictest364-21snmpd10:43:202
845202995138,9cyclictest364-21snmpd11:58:272
845202995138,10cyclictest364-21snmpd10:03:062
845202995137,10cyclictest364-21snmpd08:12:452
845202995134,13cyclictest364-21snmpd07:46:482
845195995142,6cyclictest12-21ksoftirqd/010:30:020
84520599504,6cyclictest845232-21cat07:10:013
84520599502,8cyclictest862245-21modprobe12:40:003
845202995036,11cyclictest364-21snmpd10:18:092
845202995033,13cyclictest364-21snmpd12:15:282
845202995025,17cyclictest852676-21cron09:35:002
845202995025,17cyclictest852676-21cron09:35:002
845195995034,9cyclictest0-21swapper/012:40:000
845195995032,13cyclictest857209-21latency_hist11:00:020
845195995032,13cyclictest857209-21latency_hist11:00:020
84519599502,42cyclictest846425-21modprobe07:35:000
84519599502,18cyclictest852703-21munin-run09:35:010
84519599502,18cyclictest852703-21munin-run09:35:010
845202994936,9cyclictest364-21snmpd12:39:542
845202994936,8cyclictest364-21snmpd11:14:542
845202994933,11cyclictest859910-21sshd11:53:142
845199994931,13cyclictest238-21systemd-journal12:40:001
84519599495,38cyclictest846686-21systemctl07:40:000
84519599495,38cyclictest846686-21systemctl07:40:000
845195994942,4cyclictest16950irq/224-800000008:55:010
84519599493,7cyclictest851384-21modprobe09:10:000
84519599492,42cyclictest852966-21sendmail-msp09:40:000
84520599482,14cyclictest856055-21munin-run10:40:003
845202994836,9cyclictest364-21snmpd11:40:092
845202994833,11cyclictest847675-21sshd07:55:142
845202994833,11cyclictest847675-21sshd07:55:142
845202994829,15cyclictest847961-21sshd08:02:142
845199994832,12cyclictest238-21systemd-journal11:15:021
845199994832,12cyclictest238-21systemd-journal08:40:011
845199994828,14cyclictest238-21systemd-journal11:40:001
845195994836,8cyclictest858902-21sshd11:35:000
84520599472,12cyclictest1-21systemd10:05:013
845202994734,10cyclictest364-21snmpd10:24:132
845199994739,4cyclictest855814-21latency_hist10:35:011
845195994728,15cyclictest238-21systemd-journal12:00:020
84520599452,11cyclictest851199-21grep09:05:003
845202994520,21cyclictest845326-21latency_hist07:10:022
845199994534,7cyclictest848810-21systemctl08:20:011
845199994533,8cyclictest854985-21sshd10:17:141
84519599454,16cyclictest859699-21cat11:50:010
845195994525,14cyclictest275-21dbus-daemon12:20:020
845195994513,28cyclictest12-21ksoftirqd/011:58:270
84520599442,10cyclictest238-21systemd-journal09:10:153
845199994428,12cyclictest853957-21cron10:00:001
845199994427,13cyclictest238-21systemd-journal11:55:011
845195994435,5cyclictest16950irq/224-800000009:15:010
845195994432,9cyclictest12-21ksoftirqd/008:35:020
845195994428,12cyclictest853684-21sshd09:50:140
84519599442,37cyclictest857722-21latency_hist11:10:010
845199994332,8cyclictest848218-21sshd08:09:141
845199994331,7cyclictest309-21in:imuxsock10:15:011
845199994328,11cyclictest23-21ksoftirqd/111:30:001
845199994328,10cyclictest309-21in:imuxsock12:20:001
845199994328,10cyclictest1-21systemd11:50:021
845195994327,11cyclictest856716-21cat10:50:020
845195994327,10cyclictest275-21dbus-daemon07:30:010
845195994319,19cyclictest12-21ksoftirqd/012:33:350
845195994315,23cyclictest151rcuc/010:10:020
845199994224,13cyclictest238-21systemd-journal07:20:011
84519599422,7cyclictest0-21swapper/010:15:020
84519599422,34cyclictest0-21swapper/008:00:010
84519599422,34cyclictest0-21swapper/008:00:010
845195994222,15cyclictest410-21lldpd08:15:010
845195994221,16cyclictest275-21dbus-daemon10:55:000
84519599421,15cyclictest849342-21munin-run08:30:010
84519999413,4cyclictest131rcu_preempt10:50:011
845199994127,11cyclictest23-21ksoftirqd/109:50:021
845199994125,12cyclictest275-21dbus-daemon12:10:011
845199994125,12cyclictest275-21dbus-daemon12:10:011
84519599413,29cyclictest837225-21kworker/u8:407:25:010
845195994131,7cyclictest847464-21systemd-run07:55:010
845195994126,12cyclictest847184-21sshd07:48:150
845195994125,12cyclictest0-21swapper/010:25:020
845195994120,16cyclictest275-21dbus-daemon08:40:010
845195994114,15cyclictest0-21swapper/007:10:010
845195994111,5cyclictest131rcu_preempt11:25:000
845199994030,8cyclictest23-21ksoftirqd/108:15:021
845199994030,7cyclictest855263-21sshd10:22:141
845199994029,7cyclictest23-21ksoftirqd/109:30:021
845199994027,10cyclictest23-21ksoftirqd/110:40:001
84519599405,22cyclictest851903-21modprobe09:20:000
845195994026,10cyclictest238-21systemd-journal08:25:000
845195994025,12cyclictest364-21snmpd09:43:020
845195994024,11cyclictest275-21dbus-daemon09:50:010
845195994024,11cyclictest12-21ksoftirqd/010:35:000
845199993930,5cyclictest846421-21sh07:35:001
845199993926,10cyclictest23-21ksoftirqd/112:13:171
845199993924,10cyclictest23-21ksoftirqd/107:45:001
845195993928,7cyclictest857857-21sh11:15:000
845195993922,12cyclictest1-21systemd11:20:000
845195993922,12cyclictest0-21swapper/009:25:000
845199993830,6cyclictest23-21ksoftirqd/111:15:001
845195993822,11cyclictest275-21dbus-daemon12:30:010
84519599381,4cyclictest0-21swapper/010:04:260
845199993727,8cyclictest23-21ksoftirqd/107:55:011
845199993726,8cyclictest23-21ksoftirqd/108:50:001
845199993725,10cyclictest23-21ksoftirqd/108:55:001
845199993724,9cyclictest857578-21sshd11:06:141
845199993724,9cyclictest23-21ksoftirqd/109:55:011
845199993724,10cyclictest855658-21sed10:30:021
845199993717,15cyclictest275-21dbus-daemon09:15:011
845199993710,19cyclictest851130-21modprobe09:05:001
84519599376,6cyclictest131rcu_preempt11:45:000
845195993725,8cyclictest837577-21kworker/0:107:15:010
84519999364,6cyclictest131rcu_preempt09:25:001
84519999364,4cyclictest131rcu_preempt09:10:001
845199993627,5cyclictest850865-21munin-plugin-st09:00:011
845199993626,7cyclictest23-21ksoftirqd/108:45:011
845199993625,8cyclictest23-21ksoftirqd/112:30:031
845199993625,7cyclictest854233-21sshd10:04:451
845199993625,5cyclictest857378-21latency_hist11:05:011
845199993620,12cyclictest275-21dbus-daemon12:05:001
845199993620,11cyclictest23-21ksoftirqd/109:35:011
845199993620,11cyclictest23-21ksoftirqd/109:35:011
845199993613,18cyclictest861511-21unin-run12:25:011
84519599363,25cyclictest309-21in:imuxsock08:50:010
845195993630,4cyclictest16950irq/224-800000008:10:010
84519599361,5cyclictest860961-21munin-run12:15:000
84519999353,6cyclictest131rcu_preempt09:45:001
845199993524,9cyclictest23-21ksoftirqd/108:27:141
845199993522,9cyclictest858902-21sshd11:35:001
845199993522,9cyclictest847697-21cron08:00:011
845199993522,9cyclictest847697-21cron08:00:011
845199993522,11cyclictest23-21ksoftirqd/107:25:011
845199993521,11cyclictest23-21ksoftirqd/107:40:011
845199993521,11cyclictest23-21ksoftirqd/107:40:001
84519999351,6cyclictest23-21ksoftirqd/109:40:021
84519999351,4cyclictest131rcu_preempt11:00:001
84519999351,4cyclictest131rcu_preempt11:00:001
84519599358,23cyclictest859943-21unin-run11:55:010
845195993525,7cyclictest861483-21sshd12:24:160
845199993426,6cyclictest23-21ksoftirqd/108:35:001
845199993425,7cyclictest23-21ksoftirqd/111:25:011
845199993425,5cyclictest856832-21cut10:55:001
845199993425,4cyclictest309-21in:imuxsock07:30:001
845199993424,8cyclictest23-21ksoftirqd/107:10:021
845199993423,9cyclictest23-21ksoftirqd/112:35:021
845199993423,8cyclictest23-21ksoftirqd/109:20:021
84519599344,21cyclictest851129-21modprobe09:05:000
84519599341,29cyclictest0-21swapper/012:05:060
84519599341,29cyclictest0-21swapper/012:05:050
845199993324,6cyclictest309-21in:imuxsock08:25:001
84519999332,3cyclictest131rcu_preempt12:00:001
845199993318,10cyclictest0-21swapper/110:45:021
845199993318,10cyclictest0-21swapper/110:45:011
84519599331,4cyclictest0-21swapper/008:41:140
84519999329,18cyclictest859430-21grep11:45:001
845199993224,5cyclictest847366-21latency_hist07:50:021
845199993224,5cyclictest845565-21latency_hist07:15:021
845199993222,7cyclictest847963-21sshd08:03:141
845199993221,6cyclictest854634-21latency_hist10:10:021
84519599321,27cyclictest0-21swapper/011:25:480
845195993210,3cyclictest12-21ksoftirqd/011:05:020
845195993127,2cyclictest0-21swapper/007:45:000
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional