You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-23 - 00:16

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot3s.osadl.org (updated Mon Dec 22, 2025 12:45:02)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
12167639910478,21cyclictest37-21ksoftirqd/311:25:013
1216750999082,3cyclictest0-21swapper/012:25:020
1216750998783,2cyclictest0-21swapper/012:10:020
1216750998783,2cyclictest0-21swapper/012:10:010
121675099851,81cyclictest0-21swapper/012:20:020
121675099841,3cyclictest0-21swapper/007:50:020
1216763998225,20cyclictest1227419-21cat10:35:023
1216763997925,15cyclictest1221205-21cut08:35:013
121675099772,52cyclictest12-21ksoftirqd/009:40:000
1216763996853,11cyclictest1233239-21sshd12:26:203
1216763996846,18cyclictest1218488-21sshd07:42:183
1216763996846,17cyclictest1230145-21sshd11:29:193
1216763996832,30cyclictest1231957-21cron12:05:013
1216750996818,6cyclictest0-21swapper/010:59:590
1216763996749,13cyclictest1223141-21sshd09:14:203
1216763996645,17cyclictest1233809-21munin-run12:40:003
1216763996644,17cyclictest1226787-21sshd10:24:203
121675599662,19cyclictest1220052-21systemd-run08:15:001
1216755996620,7cyclictest309-21in:imuxsock11:40:011
1216763996548,14cyclictest1217963-21sshd07:34:203
1216763996545,16cyclictest1221845-21sshd08:47:193
1216763996545,15cyclictest1222619-21sshd09:00:543
1216763996545,15cyclictest1222619-21sshd09:00:543
121675599646,17cyclictest1229911-21munin-run11:25:011
121675599644,15cyclictest1229122-21modprobe11:10:001
121675599643,18cyclictest1222374-21sendmail09:00:001
1216763996347,12cyclictest1218976-21sshd07:50:193
1216763996347,11cyclictest1231663-21sshd11:56:163
1216763996347,11cyclictest1228564-21sshd10:56:183
1216763996345,14cyclictest1229348-21sshd11:12:203
1216763996345,14cyclictest1229348-21sshd11:12:193
1216763996345,14cyclictest1228840-21sshd11:01:063
1216763996345,14cyclictest1220014-21sshd08:10:353
1216763996345,13cyclictest1226504-21sshd10:18:193
1216763996345,13cyclictest1224955-21sshd09:47:183
1216763996344,15cyclictest1231176-21sshd11:49:203
1216763996344,15cyclictest1231176-21sshd11:49:193
1216755996329,30cyclictest1231172-21sshd11:48:201
1216755996329,30cyclictest1231172-21sshd11:48:201
1216763996247,11cyclictest1230944-21munin-run11:45:013
1216763996246,12cyclictest1231414-21sshd11:51:193
1216763996246,12cyclictest1229587-21sshd11:15:183
1216763996246,12cyclictest1223679-21sshd09:24:183
1216763996246,12cyclictest1219229-21sshd07:55:183
1216763996244,14cyclictest1220850-21munin-run08:30:013
1216763996243,16cyclictest1223920-21sshd09:26:203
1216763996220,13cyclictest1220280-21modprobe08:17:003
121675599625,15cyclictest1225478-21sh10:00:001
121675599625,15cyclictest1225478-21sh10:00:001
1216755996225,4cyclictest1216906-21sshd07:10:191
121675099626,9cyclictest12-21ksoftirqd/008:05:010
1216763996151,6cyclictest1232454-21sshd12:13:193
1216763996149,9cyclictest1227813-21sshd10:42:183
1216763996147,11cyclictest1224692-21sshd09:40:203
1216763996146,11cyclictest1220558-21sshd08:21:203
1216763996146,11cyclictest1218742-21sshd07:48:203
1216763996145,13cyclictest1230631-21sshd11:36:133
1216763996145,12cyclictest1230414-21munin-run11:34:593
1216763996145,12cyclictest1217183-21sshd07:18:193
1216763996144,12cyclictest1216924-21sshd07:14:173
1216763996143,14cyclictest1232205-21sshd12:09:203
1216763996143,14cyclictest1232205-21sshd12:09:193
1216763996140,17cyclictest1223374-21sshd09:15:193
121675599612,24cyclictest1232745-21munin-plugin-st12:20:001
1216763996045,11cyclictest1227533-21sshd10:36:203
1216763996045,11cyclictest1224423-21sshd09:37:183
1216763996045,10cyclictest364-21snmpd10:45:263
1216763996044,12cyclictest1217481-21munin-run07:25:003
1216763996044,11cyclictest1225211-21sshd09:54:193
121675599604,15cyclictest1224435-21cron09:40:011
121675599603,18cyclictest1222906-21munin-plugin-st09:10:001
1216755996015,14cyclictest275-21dbus-daemon11:35:001
1216755996012,7cyclictest0-21swapper/109:20:001
1216763995946,10cyclictest1226244-21sshd10:14:193
1216763995946,10cyclictest1225732-21sshd10:01:193
1216763995944,12cyclictest1224167-21sshd09:30:573
1216763995944,12cyclictest1222352-21sshd08:58:193
1216763995944,11cyclictest364-21snmpd12:17:113
1216763995944,11cyclictest1218206-21sshd07:36:193
1216763995942,13cyclictest1228353-21munin-run10:55:023
1216755995922,10cyclictest23-21ksoftirqd/112:09:201
1216755995922,10cyclictest23-21ksoftirqd/112:09:191
1216755995921,12cyclictest275-21dbus-daemon09:50:011
1216755995917,10cyclictest1223143-21sshd09:14:201
1216763995844,11cyclictest1219508-21sshd08:00:203
1216763995843,11cyclictest1219777-21sshd08:09:193
1216763995843,11cyclictest1219777-21sshd08:09:193
1216763995843,11cyclictest1217709-21sshd07:28:183
1216763995841,13cyclictest1233518-21munin-run12:35:013
1216763995837,16cyclictest1229108-21cron11:10:013
1216755995819,12cyclictest1233384-21cat12:30:021
121675099582,38cyclictest364-21snmpd11:15:020
1216750995814,13cyclictest12-21ksoftirqd/009:10:000
1216763995750,4cyclictest1221618-21munin-run08:45:003
1216763995744,10cyclictest1222864-21sshd09:05:193
1216763995737,16cyclictest364-21snmpd10:25:343
121675999574,7cyclictest30-21ksoftirqd/207:50:002
1216750995719,9cyclictest12-21ksoftirqd/010:55:020
1216763995642,10cyclictest1225974-21sshd10:05:203
121675999569,6cyclictest131rcu_preempt07:45:012
121675999566,13cyclictest30-21ksoftirqd/211:00:002
1216755995625,4cyclictest1220307-21latency_hist08:20:021
1216755995624,9cyclictest23-21ksoftirqd/107:45:021
1216755995624,4cyclictest1217726-21latency_hist07:30:031
1216763995540,11cyclictest364-21snmpd12:23:403
1216755995522,10cyclictest23-21ksoftirqd/111:15:031
1216755995522,10cyclictest23-21ksoftirqd/111:15:031
121675599552,18cyclictest1226943-21cat10:25:011
1216763995441,10cyclictest364-21snmpd08:52:593
1216763995437,12cyclictest364-21snmpd09:56:403
1216763995437,12cyclictest364-21snmpd09:56:393
1216759995410,6cyclictest131rcu_preempt08:35:002
121675599545,7cyclictest1233760-21modprobe12:40:001
121675599543,13cyclictest238-21systemd-journal10:09:591
1216755995430,19cyclictest275-21dbus-daemon10:40:001
1216755995426,11cyclictest1222636-21cron09:05:011
1216755995426,11cyclictest1222636-21cron09:05:001
121675099549,6cyclictest131rcu_preempt12:40:000
121675099547,6cyclictest12-21ksoftirqd/011:25:020
121675999537,13cyclictest30-21ksoftirqd/208:14:592
121675099535,8cyclictest12-21ksoftirqd/010:25:010
121675099532,46cyclictest1225489-21munin-plugin-st10:00:010
121675099532,46cyclictest1225489-21munin-plugin-st10:00:000
1216759995212,11cyclictest131rcu_preempt08:30:032
121675599529,8cyclictest0-21swapper/108:40:001
121675599526,14cyclictest1219256-21modprobe08:00:001
121676399514,7cyclictest131rcu_preempt08:40:013
1216750995113,9cyclictest12-21ksoftirqd/007:35:030
121675999507,11cyclictest30-21ksoftirqd/212:25:012
1216755995026,17cyclictest238-21systemd-journal07:25:001
121675099503,6cyclictest12-21ksoftirqd/007:30:010
1216750995012,5cyclictest131rcu_preempt08:40:020
121675999496,10cyclictest30-21ksoftirqd/207:35:012
1216759994927,16cyclictest238-21systemd-journal08:49:592
1216759994918,21cyclictest291rcuc/208:20:012
1216755994921,9cyclictest23-21ksoftirqd/110:20:021
1216755994914,24cyclictest1217195-21modprobe07:19:591
1216750994940,6cyclictest12-21ksoftirqd/012:30:010
1216763994826,17cyclictest1216831-21wc07:10:023
121675999485,9cyclictest30-21ksoftirqd/212:14:592
121675999483,8cyclictest30-21ksoftirqd/207:30:012
121675999482,6cyclictest131rcu_preempt08:05:012
121675099483,6cyclictest1217209-21modprobe07:20:000
121675099482,9cyclictest12-21ksoftirqd/007:45:010
1216759994728,14cyclictest238-21systemd-journal09:24:592
1216755994733,11cyclictest1221590-21sshd08:41:191
1216755994730,10cyclictest1227307-21munin-plugin-st10:35:011
121675099473,33cyclictest19350irq/34-mmc110:50:020
121675999464,11cyclictest30-21ksoftirqd/212:35:002
1216759994638,6cyclictest30-21ksoftirqd/210:15:022
1216759994631,11cyclictest275-21dbus-daemon11:00:192
1216759994626,14cyclictest238-21systemd-journal10:25:002
1216759994611,6cyclictest131rcu_preempt10:50:012
121675099466,9cyclictest12-21ksoftirqd/011:34:590
121675099466,6cyclictest12-21ksoftirqd/008:35:010
121675099466,5cyclictest12-21ksoftirqd/011:10:010
1216750994639,4cyclictest16950irq/224-800000009:00:000
1216750994638,5cyclictest151rcuc/010:20:010
1216750994636,6cyclictest1233530-21systemd-run12:35:010
1216750994611,5cyclictest131rcu_preempt09:15:020
121675999458,6cyclictest131rcu_preempt12:05:012
1216759994537,6cyclictest291rcuc/208:40:032
1216759994531,10cyclictest30-21ksoftirqd/210:05:002
1216755994532,10cyclictest23-21ksoftirqd/108:55:001
121675599452,11cyclictest1219550-21systemd-run08:05:001
1216755994519,18cyclictest275-21dbus-daemon08:35:011
1216755994513,21cyclictest1218229-21modprobe07:39:591
121675099456,8cyclictest12-21ksoftirqd/011:30:030
121675099456,7cyclictest12-21ksoftirqd/009:45:020
1216750994536,4cyclictest16950irq/224-800000008:20:000
1216750994529,13cyclictest1224177-21sshd09:33:180
1216750994528,12cyclictest309-21in:imuxsock07:40:000
1216750994527,15cyclictest1231722-21sendmail-msp12:00:000
121675099452,14cyclictest238-21systemd-journal10:30:190
1216750994516,6cyclictest12-21ksoftirqd/011:38:320
1216750994514,12cyclictest12-21ksoftirqd/008:00:010
121675999447,5cyclictest131rcu_preempt08:10:022
121675999447,5cyclictest131rcu_preempt08:10:012
1216759994411,5cyclictest131rcu_preempt10:00:032
1216759994411,5cyclictest131rcu_preempt10:00:022
121675099447,32cyclictest151rcuc/011:11:200
121675099447,32cyclictest151rcuc/011:11:190
121675099446,10cyclictest12-21ksoftirqd/008:10:010
121675099446,10cyclictest12-21ksoftirqd/008:10:010
1216750994437,4cyclictest16950irq/224-800000009:20:000
121675099443,6cyclictest12-21ksoftirqd/009:55:000
1216750994413,11cyclictest12-21ksoftirqd/009:05:020
1216750994413,11cyclictest12-21ksoftirqd/009:05:010
121675099441,11cyclictest12-21ksoftirqd/008:30:020
121675999434,10cyclictest30-21ksoftirqd/211:15:012
121675999434,10cyclictest30-21ksoftirqd/211:15:002
1216759994330,9cyclictest1232738-21cat12:20:012
1216759994316,16cyclictest30-21ksoftirqd/211:25:012
1216759994312,6cyclictest131rcu_preempt07:58:192
121675099437,7cyclictest12-21ksoftirqd/007:13:170
121675099436,6cyclictest12-21ksoftirqd/007:25:010
121675099435,9cyclictest12-21ksoftirqd/008:50:000
121675099432,13cyclictest1220053-21true08:15:010
1216750994310,5cyclictest131rcu_preempt09:25:000
121675999428,6cyclictest131rcu_preempt09:50:022
121675999422,6cyclictest30-21ksoftirqd/209:00:192
121675999422,6cyclictest30-21ksoftirqd/209:00:182
121675999421,7cyclictest30-21ksoftirqd/211:20:012
1216755994226,11cyclictest309-21in:imuxsock10:10:021
1216755994221,14cyclictest309-21in:imuxsock10:25:031
121675099424,9cyclictest12-21ksoftirqd/010:38:200
121675099423,8cyclictest12-21ksoftirqd/012:15:020
121675999416,5cyclictest131rcu_preempt10:45:002
121675999413,29cyclictest1230388-21kworker/u8:211:40:012
1216759994129,8cyclictest30-21ksoftirqd/210:55:012
1216759994126,11cyclictest291rcuc/209:00:012
1216759994115,16cyclictest131rcu_preempt12:40:012
1216755994129,9cyclictest1229629-21cron11:19:591
1216755994125,12cyclictest238-21systemd-journal11:00:201
1216755994123,13cyclictest275-21dbus-daemon09:30:001
121675099416,8cyclictest12-21ksoftirqd/010:05:000
121675099416,7cyclictest12-21ksoftirqd/011:53:190
1216750994131,7cyclictest12-21ksoftirqd/010:45:010
121675999404,4cyclictest131rcu_preempt09:40:022
121675999403,8cyclictest30-21ksoftirqd/212:06:202
121675999403,8cyclictest30-21ksoftirqd/212:06:202
121675999403,8cyclictest30-21ksoftirqd/207:55:012
121675999403,4cyclictest131rcu_preempt09:10:012
1216759994031,6cyclictest30-21ksoftirqd/210:30:012
1216759994028,9cyclictest291rcuc/210:20:012
1216759994027,9cyclictest30-21ksoftirqd/209:20:022
1216759994026,10cyclictest30-21ksoftirqd/212:29:592
1216759994024,13cyclictest30-21ksoftirqd/212:00:022
1216759994023,13cyclictest238-21systemd-journal09:40:002
121675999401,5cyclictest131rcu_preempt09:50:192
1216759994015,20cyclictest291rcuc/209:35:022
1216755994026,8cyclictest309-21in:imuxsock11:00:001
1216755994024,11cyclictest23-21ksoftirqd/112:00:011
1216755994024,11cyclictest1224199-21munin-run09:35:001
1216750994030,6cyclictest1218996-21modprobe07:54:180
121675099402,9cyclictest12-21ksoftirqd/011:45:010
1216750994029,8cyclictest12-21ksoftirqd/011:50:020
1216750994029,8cyclictest12-21ksoftirqd/011:50:010
1216750994021,15cyclictest1231941-21sshd12:01:180
121675999399,5cyclictest131rcu_preempt09:11:182
121675999393,9cyclictest30-21ksoftirqd/209:30:012
121675999393,8cyclictest30-21ksoftirqd/211:45:022
121675999392,8cyclictest30-21ksoftirqd/207:40:002
121675999391,10cyclictest30-21ksoftirqd/211:30:022
121675099398,5cyclictest131rcu_preempt08:40:010
121675099397,8cyclictest12-21ksoftirqd/009:50:010
121675099392,6cyclictest1226016-21true10:10:010
121675099392,12cyclictest12-21ksoftirqd/010:30:010
121675099391,8cyclictest0-21swapper/009:29:330
1216750993914,21cyclictest12-21ksoftirqd/010:15:010
121675099391,34cyclictest1216824-21date07:10:020
121675999385,28cyclictest1217468-21cron07:25:012
1216759993830,6cyclictest30-21ksoftirqd/211:55:012
1216759993830,5cyclictest30-21ksoftirqd/208:50:512
1216759993826,9cyclictest291rcuc/210:40:012
121675599384,20cyclictest1223690-21modprobe09:25:001
1216755993825,10cyclictest275-21dbus-daemon07:35:011
1216755993822,13cyclictest1225397-21sed09:55:031
1216755993822,12cyclictest23-21ksoftirqd/107:10:011
1216755993818,13cyclictest309-21in:imuxsock11:45:001
1216755993811,22cyclictest1230175-21unin-run11:30:001
121675099385,5cyclictest12-21ksoftirqd/011:05:000
121675999379,5cyclictest131rcu_preempt08:35:192
121675599375,21cyclictest238-21systemd-journal11:54:591
1216755993723,8cyclictest0-21swapper/108:10:011
1216755993723,8cyclictest0-21swapper/108:10:001
1216750993724,9cyclictest1220569-21sshd08:24:200
1216759993624,8cyclictest30-21ksoftirqd/208:25:022
1216759993623,9cyclictest0-21swapper/211:35:012
121675599366,6cyclictest131rcu_preempt12:10:201
121675599364,19cyclictest1233006-21modprobe12:25:011
121675999356,5cyclictest131rcu_preempt07:16:182
1216759993521,10cyclictest30-21ksoftirqd/207:15:022
1216755993523,9cyclictest23-21ksoftirqd/110:45:021
1216755993523,9cyclictest23-21ksoftirqd/109:44:591
1216755993522,9cyclictest23-21ksoftirqd/108:25:001
1216759993415,15cyclictest131rcu_preempt11:50:022
1216759993415,15cyclictest131rcu_preempt11:50:012
121675599342,4cyclictest131rcu_preempt12:05:021
1216755993423,8cyclictest275-21dbus-daemon10:05:011
1216759993320,10cyclictest30-21ksoftirqd/210:09:592
121675999331,6cyclictest0-21swapper/210:35:002
121675599334,4cyclictest131rcu_preempt08:50:001
1216755993326,5cyclictest1228077-21cron10:50:011
121675599332,5cyclictest131rcu_preempt08:30:001
121675599332,5cyclictest131rcu_preempt07:49:191
1216755993322,8cyclictest23-21ksoftirqd/107:55:001
1216755993321,8cyclictest1228338-21munin-plugin-st10:55:001
1216750993326,4cyclictest1222177-21latency_hist08:55:020
121675599325,4cyclictest131rcu_preempt12:35:001
1216759993115,13cyclictest30-21ksoftirqd/211:10:012
1216759992716,7cyclictest1216856-21cat07:10:032
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional