You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-12 - 03:37

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot3s.osadl.org (updated Mon Jan 12, 2026 00:45:11)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
4170807998212,21cyclictest16850irq/134-800000023:35:580
4170811997721,15cyclictest4173082-21/usr/sbin/munin19:55:011
4170811997721,15cyclictest4172429-21cat19:40:011
4170811997715,25cyclictest58039-21ssh23:53:401
417080799771,5cyclictest4192966-21munin-run21:45:000
4170811997618,19cyclictest68222-21ssh00:15:341
4170811997618,19cyclictest68222-21ssh00:15:331
4170811997612,28cyclictest19240-21ssh22:28:591
4170807997626,17cyclictest32229-21ssh22:57:140
4170807997613,53cyclictest16850irq/134-800000023:51:270
4170811997523,12cyclictest4315-21ssh21:56:091
4170811997516,22cyclictest73676-21ssh00:27:461
4170811997421,17cyclictest4180503-21ssh21:17:441
4170807997427,12cyclictest4181541-21ssh21:20:010
4170807997411,53cyclictest16850irq/134-800000021:39:000
4170807997411,53cyclictest16850irq/134-800000021:38:590
4170807997327,12cyclictest15883-21ssh22:21:220
4170807997237,32cyclictest16950irq/224-800000020:45:010
4170811997115,17cyclictest7895-21ssh22:04:291
4170811997115,17cyclictest7895-21ssh22:04:291
4170811997114,19cyclictest61885-21ssh00:01:511
4170811997114,19cyclictest61885-21ssh00:01:501
4170811997020,20cyclictest4183312-21ssh21:23:441
4170811997017,15cyclictest49198-21ssh23:34:361
4170807997010,49cyclictest16850irq/134-800000023:16:360
4170807996933,32cyclictest16950irq/224-800000021:10:010
4170807996931,33cyclictest275-21dbus-daemon19:30:010
417080799692,62cyclictest56399-21latency_hist23:50:020
4170811996813,15cyclictest60205-21ssh23:58:201
417080799685,52cyclictest16850irq/134-800000021:21:040
417080799682,5cyclictest49268-21sh23:34:460
4170807996812,47cyclictest16850irq/134-800000000:15:570
4170807996812,47cyclictest16850irq/134-800000000:15:570
4170807996810,48cyclictest16850irq/134-800000022:15:140
4170811996725,15cyclictest51061-21sh23:38:261
4170811996714,16cyclictest16764-21ssh22:23:271
4170811996713,15cyclictest10706-21modprobe22:10:031
4170807996727,34cyclictest16850irq/134-800000022:45:000
4170807996726,3cyclictest0-21swapper/019:50:020
4170807996722,9cyclictest52922-21ssh23:42:210
417080799671,61cyclictest3807-21wc21:55:020
4170811996624,8cyclictest41208-21ssh23:16:521
4170811996617,13cyclictest37102-21ssh23:07:531
4170811996615,16cyclictest4192622-21ssh21:44:141
4170811996612,17cyclictest71128-21ssh00:22:041
4170811996612,17cyclictest4177414-21ssh21:10:451
4170807996630,32cyclictest16950irq/224-800000000:00:030
4170807996622,16cyclictest3467602-21systemd-journal00:10:000
4170807996615,8cyclictest12-21ksoftirqd/021:11:510
417080799661,3cyclictest0-21swapper/019:40:010
4170811996515,15cyclictest55141-21ssh23:47:151
417080799651,34cyclictest4173638-21sed20:05:010
4170811996423,7cyclictest4193573-21ssh21:45:551
4170811996418,14cyclictest76240-21ssh00:33:311
417080799643,5cyclictest79181-21munin-run00:40:000
4170807996427,5cyclictest73137-21sh00:26:290
4170807996422,5cyclictest28799-21latency_hist22:50:030
4170807996422,13cyclictest7875-21ssh22:04:260
4170807996422,13cyclictest7875-21ssh22:04:250
4170807996418,12cyclictest4887-21ssh21:57:410
4170807996417,41cyclictest16850irq/134-800000022:31:470
4170807996416,6cyclictest16850irq/134-800000000:02:020
4170807996416,6cyclictest16850irq/134-800000000:02:010
4170817996327,10cyclictest37-21ksoftirqd/300:25:013
4170811996318,14cyclictest4177013-21diskmemload22:55:521
4170811996315,14cyclictest30779-21ssh22:54:091
4170811996313,14cyclictest45300-21ssh23:25:341
4170811996313,14cyclictest4189269-21ssh21:36:351
4170811996313,14cyclictest4189269-21ssh21:36:341
4170811996311,17cyclictest38240-21ssh23:10:121
4170807996329,31cyclictest0-21swapper/019:55:020
417080799631,35cyclictest4188445-21sed21:35:010
4170807996310,48cyclictest16850irq/134-800000022:05:330
4170811996213,15cyclictest78632-21ssh00:38:521
4170807996221,7cyclictest12-21ksoftirqd/019:59:450
4170811996119,6cyclictest65277-21ssh00:09:291
4170811996113,14cyclictest23636-21ssh22:38:411
4170811996113,14cyclictest23636-21ssh22:38:401
4170807996135,21cyclictest16850irq/134-800000022:15:000
4170807996128,12cyclictest35901-21cat23:05:020
4170807996125,9cyclictest12-21ksoftirqd/000:22:230
4170807996125,5cyclictest17887-21sh22:25:460
4170807996125,16cyclictest40406-21rm23:15:030
4170807996122,12cyclictest12-21ksoftirqd/023:29:520
4170807996118,13cyclictest44641-21ssh23:24:320
4170813996043,11cyclictest1-21systemd22:10:012
4170811996022,13cyclictest67474-21ssh00:14:191
4170811996017,10cyclictest0-21swapper/122:49:141
4170811996016,14cyclictest13941-21ssh22:17:221
4170811996014,13cyclictest10216-21ssh22:09:241
4170811996011,14cyclictest4188173-21ssh21:34:301
4170807996029,26cyclictest0-21swapper/000:35:020
4170807996022,11cyclictest275-21dbus-daemon21:05:000
4170807996021,4cyclictest16950irq/224-800000020:05:030
4170813995940,14cyclictest31379-21latency_hist22:55:032
4170811995946,10cyclictest34271-21ssh23:01:391
4170811995915,14cyclictest43704-21ssh23:22:151
4170811995912,14cyclictest1746-21ssh21:50:311
4170807995924,7cyclictest12-21ksoftirqd/023:08:160
4170807995922,9cyclictest16950irq/224-800000021:26:370
4170807995922,9cyclictest16950irq/224-800000021:26:360
417081199589,15cyclictest4171802-21systemd-run19:30:011
4170811995845,10cyclictest4184187-21ssh21:25:281
4170811995845,10cyclictest4184187-21ssh21:25:271
4170817995725,27cyclictest37-21ksoftirqd/323:40:033
4170817995712,5cyclictest131rcu_preempt22:05:013
4170817995712,5cyclictest131rcu_preempt22:05:003
4170807995723,6cyclictest12-21ksoftirqd/022:36:190
4170807995723,6cyclictest12-21ksoftirqd/022:36:190
4170811995639,13cyclictest0-21swapper/122:31:461
4170811995611,16cyclictest54057-21ssh23:45:011
4170807995623,12cyclictest29072-21kworker/u8:122:55:020
4170807995622,5cyclictest66811-21sh00:12:430
4170811995542,10cyclictest24544-21ssh22:40:141
4170811995436,14cyclictest4176742-21sshd21:03:461
4170807995424,4cyclictest0-21swapper/021:45:270
4170813995335,11cyclictest3467602-21systemd-journal22:41:572
4170807995335,14cyclictest3467602-21systemd-journal19:20:000
417080799521,26cyclictest0-21swapper/019:15:030
4170817995134,12cyclictest1-21systemd20:20:003
4170813995131,16cyclictest4181492-21cat21:20:002
4170807995125,22cyclictest12-21ksoftirqd/020:47:020
4170807995125,22cyclictest12-21ksoftirqd/020:47:010
4170813995033,7cyclictest309-21in:imuxsock00:20:012
4170813995033,7cyclictest309-21in:imuxsock00:20:002
4170811995036,10cyclictest4171227-21cron19:16:591
4170811995033,11cyclictest1-21systemd20:00:011
4170807995040,7cyclictest0-21swapper/019:10:010
4170807995031,15cyclictest275-21dbus-daemon19:25:010
4170813994937,9cyclictest1-21systemd21:35:012
4170811994915,30cyclictest3467602-21systemd-journal20:50:011
4170811994915,30cyclictest3467602-21systemd-journal20:50:001
4170817994838,6cyclictest4181538-21unin-run21:20:013
4170817994830,14cyclictest275-21dbus-daemon22:30:023
417081799481,41cyclictest361rcuc/322:55:023
4170811994837,7cyclictest4174895-21munin-run20:30:001
4170811994835,9cyclictest4171506-21sshd19:21:281
4170811994835,10cyclictest4174349-21sshd20:19:451
4170811994834,10cyclictest4172534-21sshd19:40:451
4170811994834,10cyclictest4172534-21sshd19:40:441
417081399475,29cyclictest3467602-21systemd-journal23:50:002
4170813994736,7cyclictest309-21in:imuxsock21:45:022
4170813994730,13cyclictest1-21systemd23:10:002
4170813994730,11cyclictest3467602-21systemd-journal00:00:002
4170813994729,14cyclictest275-21dbus-daemon21:30:012
4170813994729,14cyclictest275-21dbus-daemon21:30:002
4170811994734,10cyclictest364-21snmpd19:45:351
4170811994733,11cyclictest4176991-21sshd21:08:451
4170817994630,12cyclictest37-21ksoftirqd/300:40:013
4170817994627,15cyclictest275-21dbus-daemon19:40:013
417081399464,3cyclictest131rcu_preempt22:36:452
417081399464,3cyclictest131rcu_preempt22:36:442
4170813994631,11cyclictest30-21ksoftirqd/223:40:012
4170813994627,14cyclictest1-21systemd21:55:022
4170811994634,9cyclictest364-21snmpd20:30:451
4170811994633,10cyclictest4172019-21sshd19:33:461
4170811994632,10cyclictest4176230-21munin-run20:55:001
417080799461,3cyclictest131rcu_preempt19:35:010
4170813994533,9cyclictest4189345-21sshd21:36:462
4170813994533,9cyclictest4189345-21sshd21:36:452
4170813994526,15cyclictest1-21systemd23:30:012
4170811994511,6cyclictest23-21ksoftirqd/120:05:451
4170807994537,4cyclictest16950irq/224-800000021:00:010
4170807994529,11cyclictest3467602-21systemd-journal20:19:460
4170817994431,9cyclictest3467602-21systemd-journal23:10:023
4170817994427,13cyclictest275-21dbus-daemon21:35:003
417081399443,3cyclictest131rcu_preempt00:15:022
4170813994429,11cyclictest3467602-21systemd-journal19:11:452
4170813994426,14cyclictest35680-21modprobe23:05:012
4170813994425,14cyclictest275-21dbus-daemon22:59:592
4170811994427,13cyclictest364-21snmpd20:58:481
4170811994418,21cyclictest4170886-21cat19:10:031
4170817994333,8cyclictest4190118-21sshd21:38:463
4170817994333,8cyclictest4190118-21sshd21:38:453
4170817994325,14cyclictest3467602-21systemd-journal21:10:023
417081399437,24cyclictest3467602-21systemd-journal21:59:592
4170813994328,11cyclictest3467602-21systemd-journal22:25:022
417081399432,4cyclictest131rcu_preempt22:03:182
417081399432,4cyclictest131rcu_preempt22:03:172
417081399432,3cyclictest131rcu_preempt23:51:042
417081399431,3cyclictest131rcu_preempt22:24:162
4170811994331,9cyclictest4173582-21sshd20:03:451
4170811994323,16cyclictest4175870-21sed20:45:021
4170807994323,13cyclictest275-21dbus-daemon20:15:010
417081799424,4cyclictest131rcu_preempt20:35:003
4170817994226,12cyclictest37-21ksoftirqd/323:51:133
4170817994220,16cyclictest275-21dbus-daemon19:50:003
4170813994224,13cyclictest275-21dbus-daemon00:25:012
4170811994230,9cyclictest364-21snmpd20:37:241
4170811994230,9cyclictest364-21snmpd20:21:541
4170811994227,10cyclictest4170985-21cron19:15:001
417081799414,4cyclictest131rcu_preempt19:20:003
417081799413,3cyclictest131rcu_preempt23:00:023
4170817994131,6cyclictest309-21in:imuxsock22:50:013
4170817994129,9cyclictest4193496-21sshd21:45:463
4170817994128,10cyclictest56456-21date23:50:033
4170817994127,11cyclictest1-21systemd19:45:013
4170817994127,11cyclictest1-21systemd19:45:003
4170813994130,7cyclictest4176450-21sshd20:56:342
4170813994128,10cyclictest30-21ksoftirqd/221:42:102
4170813994125,12cyclictest1-21systemd23:25:002
417081399412,4cyclictest131rcu_preempt22:16:272
417081399412,3cyclictest131rcu_preempt00:35:012
417081399411,6cyclictest0-21swapper/222:32:342
4170813994116,16cyclictest275-21dbus-daemon19:40:012
4170813994113,20cyclictest12779-21modprobe22:15:002
4170811994128,9cyclictest364-21snmpd20:10:051
417080799413,8cyclictest4174875-21sshd20:28:460
417080799411,31cyclictest0-21swapper/020:30:440
417081799408,5cyclictest131rcu_preempt23:22:473
4170817994027,10cyclictest37-21ksoftirqd/320:50:033
4170817994027,10cyclictest13843-21cron22:17:013
417081799402,5cyclictest26615-21sed22:45:013
417081799401,5cyclictest131rcu_preempt22:40:013
417081799401,5cyclictest131rcu_preempt22:40:013
4170813994028,9cyclictest30-21ksoftirqd/222:47:262
4170813994026,10cyclictest65496-21modprobe00:10:002
417081399402,3cyclictest131rcu_preempt23:18:192
4170813994022,14cyclictest1-21systemd00:40:012
4170813994020,15cyclictest3467602-21systemd-journal00:05:012
4170813994020,15cyclictest3467602-21systemd-journal00:05:002
417081799399,6cyclictest131rcu_preempt21:56:473
4170817993927,10cyclictest37-21ksoftirqd/300:03:303
4170817993927,10cyclictest37-21ksoftirqd/300:03:293
4170817993925,11cyclictest37-21ksoftirqd/322:25:003
4170817993925,11cyclictest275-21dbus-daemon21:15:013
4170813993930,6cyclictest4172026-21cron19:34:592
4170813993927,8cyclictest3467602-21systemd-journal20:39:592
4170813993924,12cyclictest3467602-21systemd-journal21:25:002
4170813993921,12cyclictest275-21dbus-daemon20:10:012
4170813993915,18cyclictest275-21dbus-daemon20:25:002
4170807993924,9cyclictest0-21swapper/020:40:000
417081799388,6cyclictest131rcu_preempt22:08:543
4170817993828,8cyclictest37-21ksoftirqd/323:18:153
4170817993827,8cyclictest3467602-21systemd-journal00:30:453
4170817993826,9cyclictest37-21ksoftirqd/322:33:443
4170817993826,8cyclictest3467602-21systemd-journal21:00:023
4170817993825,8cyclictest4171793-21cut19:30:003
417081799382,3cyclictest131rcu_preempt21:45:013
4170817993823,12cyclictest37-21ksoftirqd/323:32:253
4170817993820,14cyclictest275-21dbus-daemon21:00:013
417081399386,7cyclictest30-21ksoftirqd/219:10:022
4170813993822,12cyclictest275-21dbus-daemon20:05:002
4170813993814,18cyclictest3467602-21systemd-journal19:50:012
417080799382,4cyclictest0-21swapper/020:55:000
417081799373,3cyclictest131rcu_preempt00:30:013
4170817993728,5cyclictest60915-21sh00:00:023
4170817993725,9cyclictest37-21ksoftirqd/323:05:573
4170817993724,9cyclictest4171524-21cron19:25:013
417081799372,3cyclictest131rcu_preempt21:25:003
4170817993723,10cyclictest3467602-21systemd-journal20:50:003
4170817993721,12cyclictest275-21dbus-daemon00:10:013
417081399377,18cyclictest311-21rs:main2
417081399377,18cyclictest311-21rs:main2
417081399375,4cyclictest131rcu_preempt21:10:462
417081399374,5cyclictest131rcu_preempt00:26:212
4170813993729,5cyclictest52053-21sh23:40:122
4170813993727,7cyclictest40217-21sh23:15:012
417080799374,4cyclictest131rcu_preempt20:25:000
4170807993721,12cyclictest4172554-21sshd19:44:460
4170807993721,12cyclictest4172554-21sshd19:44:450
417081799366,3cyclictest131rcu_preempt19:15:023
417081799364,3cyclictest131rcu_preempt19:10:023
4170817993627,7cyclictest37-21ksoftirqd/323:02:203
4170817993627,6cyclictest4177013-21diskmemload00:15:003
4170817993626,8cyclictest37-21ksoftirqd/321:55:023
4170817993625,9cyclictest37-21ksoftirqd/320:30:023
4170817993624,9cyclictest4174741-21wc20:25:013
4170817993624,9cyclictest1-21systemd23:25:473
4170817993624,10cyclictest37-21ksoftirqd/322:13:543
4170817993624,10cyclictest37-21ksoftirqd/321:29:343
4170817993624,10cyclictest37-21ksoftirqd/321:29:333
4170817993623,10cyclictest37-21ksoftirqd/300:15:143
4170817993623,10cyclictest37-21ksoftirqd/300:15:133
4170817993623,10cyclictest275-21dbus-daemon23:45:003
417081799361,4cyclictest131rcu_preempt19:34:593
417081399368,22cyclictest4175973-21modprobe20:50:012
417081399368,22cyclictest4175973-21modprobe20:50:002
4170813993626,7cyclictest30-21ksoftirqd/219:50:442
4170813993624,10cyclictest30-21ksoftirqd/220:35:022
4170813993620,11cyclictest275-21dbus-daemon19:25:002
4170817993526,6cyclictest1-21systemd20:10:003
417081399358,18cyclictest0-21swapper/220:20:002
4170813993521,10cyclictest3467602-21systemd-journal19:56:292
4170813993519,12cyclictest30-21ksoftirqd/221:10:012
417081399351,3cyclictest131rcu_preempt23:30:302
4170817993426,5cyclictest4174092-21cron20:15:003
4170817993425,6cyclictest309-21in:imuxsock20:00:013
417081799341,3cyclictest131rcu_preempt20:05:003
4170813993427,4cyclictest4174867-21sshd20:26:452
4170813993424,5cyclictest0-21swapper/219:30:032
417081799331,29cyclictest4176217-21cron20:54:593
417081399334,21cyclictest4176763-21grep21:05:012
417081399334,21cyclictest4171258-21cron19:20:012
4170813993218,11cyclictest4176351-21sed20:55:012
4170817993123,6cyclictest37-21ksoftirqd/320:45:003
417081399316,17cyclictest4175680-21grep20:45:012
4170817993018,9cyclictest309-21in:imuxsock19:55:013
4170817993018,10cyclictest37-21ksoftirqd/320:36:343
417081399302,4cyclictest131rcu_preempt20:15:002
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional