You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-10-24 - 15:45

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot3s.osadl.org (updated Fri Oct 24, 2025 00:45:01)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
16395199912,62cyclictest176404-21cron23:10:012
16395199762,4cyclictest131rcu_preempt20:55:012
16395199691,38cyclictest1-21systemd00:20:002
163951996729,35cyclictest174343-21latency_hist22:30:012
16395199668,54cyclictest168534-21sshd20:39:162
163951996529,30cyclictest181089-21cron00:39:592
163942996547,11cyclictest163946-21latency_hist19:10:020
163951996325,34cyclictest173817-21latency_hist22:20:012
163951996322,36cyclictest177207-21latency_hist23:25:022
16395199631,57cyclictest174093-21munin-run22:25:012
16395199631,56cyclictest235-21systemd-journal19:45:002
16395199622,56cyclictest168268-21sshd20:31:182
16395199622,53cyclictest175367-21cron22:50:002
16395199621,57cyclictest172496-21sshd21:53:172
16395199621,57cyclictest169847-21sshd21:02:532
16395199621,56cyclictest177435-21sshd23:27:172
16395199621,55cyclictest48-21kcompactd022:51:022
16395199613,54cyclictest1-21systemd20:55:502
163951996124,32cyclictest30-21ksoftirqd/223:15:022
16395199611,55cyclictest170892-21sshd21:20:182
16395199611,55cyclictest164905-21sshd19:27:352
16394799615,36cyclictest177178-21kworker/u8:323:30:021
16395199601,55cyclictest363-21snmpd22:06:202
16395199601,55cyclictest363-21snmpd20:46:032
16395199601,55cyclictest166233-21munin-run19:55:012
16395199601,55cyclictest165165-21sshd19:34:172
16395199601,55cyclictest164370-21sshd19:17:162
16395199601,54cyclictest48-21kcompactd023:17:442
16395199601,54cyclictest48-21kcompactd022:30:272
16395199601,54cyclictest363-21snmpd23:01:052
16395199601,53cyclictest48-21kcompactd023:37:132
16395199592,53cyclictest180849-21munin-run00:35:002
16395199591,54cyclictest177693-21sshd23:33:192
16395199591,54cyclictest171149-21sshd21:26:162
16395199591,54cyclictest171149-21sshd21:26:162
16395199591,53cyclictest48-21kcompactd000:27:482
16395199591,53cyclictest48-21kcompactd000:27:472
16395199582,51cyclictest171431-21munin-run21:35:002
16395199581,54cyclictest166733-21sshd20:04:172
16395199581,53cyclictest178976-21sshd23:57:182
16395199581,53cyclictest178976-21sshd23:57:172
16395199581,53cyclictest172125-21cat21:45:042
16395199581,52cyclictest48-21kcompactd021:57:432
16395199572,51cyclictest179776-21sshd00:14:202
16395199572,49cyclictest170389-21munin-run21:15:012
16395199571,52cyclictest167504-21cron20:20:012
16395199571,52cyclictest166967-21sshd20:05:172
16395199571,51cyclictest48-21kcompactd022:14:552
16395199571,51cyclictest48-21kcompactd022:04:542
16395199571,51cyclictest48-21kcompactd000:08:562
16394799576,14cyclictest0-21swapper/120:40:001
163947995735,14cyclictest23-21ksoftirqd/120:00:021
16395199562,50cyclictest363-21snmpd21:18:382
16395199562,49cyclictest164691-21munin-run19:25:012
16395199561,51cyclictest363-21snmpd20:24:272
16395199561,50cyclictest363-21snmpd22:56:232
16395199561,49cyclictest48-21kcompactd023:50:372
16394299565,3cyclictest131rcu_preempt19:42:390
16395199551,50cyclictest363-21snmpd19:35:452
16395199551,49cyclictest48-21kcompactd023:42:462
16395199551,49cyclictest363-21snmpd20:40:532
16394799555,35cyclictest221rcuc/121:15:031
16395199542,48cyclictest48-21kcompactd000:00:042
16395199542,48cyclictest363-21snmpd21:37:322
16395199541,49cyclictest48-21kcompactd000:20:352
16395199541,49cyclictest363-21snmpd22:43:082
16395199541,49cyclictest363-21snmpd19:57:292
16395199541,49cyclictest363-21snmpd19:11:082
16395199541,49cyclictest235-21systemd-journal20:11:172
16395199541,49cyclictest178580-21latency_hist23:50:022
16395199541,48cyclictest363-21snmpd22:37:082
16395199541,48cyclictest363-21snmpd22:37:072
16395199532,48cyclictest363-21snmpd21:46:512
16395199532,47cyclictest363-21snmpd20:28:122
16395199531,48cyclictest363-21snmpd19:47:112
163947995332,15cyclictest272-21dbus-daemon20:20:001
163942995336,12cyclictest235-21systemd-journal22:25:010
16395199521,47cyclictest363-21snmpd21:05:112
163942995218,9cyclictest235-21systemd-journal19:20:000
163947994835,8cyclictest1-21systemd00:00:011
163947994835,8cyclictest1-21systemd00:00:001
16394299488,12cyclictest131rcu_preempt23:25:010
16394299483,6cyclictest172255-21latency_hist21:50:010
163942994828,14cyclictest272-21dbus-daemon22:45:010
163956994733,11cyclictest235-21systemd-journal21:15:003
163956994731,12cyclictest235-21systemd-journal21:30:023
163956994731,12cyclictest235-21systemd-journal21:00:003
16395699472,9cyclictest37-21ksoftirqd/300:00:003
16395699472,9cyclictest37-21ksoftirqd/300:00:003
16395199472,42cyclictest163879-21latency_hist19:10:012
163947994730,12cyclictest1-21systemd21:55:011
163942994735,9cyclictest12-21ksoftirqd/023:15:000
163942994731,12cyclictest272-21dbus-daemon22:20:010
163942994729,12cyclictest272-21dbus-daemon23:40:020
163942994726,16cyclictest1-21systemd00:00:000
163942994726,16cyclictest1-21systemd00:00:000
16395699467,7cyclictest37-21ksoftirqd/320:55:003
163942994630,12cyclictest1-21systemd21:05:000
163942994628,13cyclictest272-21dbus-daemon21:45:010
16395699453,4cyclictest131rcu_preempt21:10:003
163956994526,15cyclictest1-21systemd21:50:013
163947994532,9cyclictest235-21systemd-journal21:26:181
163947994532,9cyclictest235-21systemd-journal21:26:171
163947994429,12cyclictest23-21ksoftirqd/121:40:001
163947994428,12cyclictest235-21systemd-journal20:05:001
163947994428,12cyclictest1-21systemd22:40:011
163947994428,12cyclictest1-21systemd22:40:011
163942994437,4cyclictest16950irq/224-800000022:15:010
163942994437,4cyclictest16950irq/224-800000022:10:010
163942994428,12cyclictest235-21systemd-journal19:59:170
16394299442,11cyclictest179289-21munin-run00:04:590
16394299441,39cyclictest0-21swapper/023:00:010
163956994329,11cyclictest37-21ksoftirqd/320:22:483
163947994331,9cyclictest23-21ksoftirqd/122:00:001
163947994329,10cyclictest272-21dbus-daemon19:30:011
163942994336,4cyclictest16950irq/224-800000000:08:190
163942994332,7cyclictest12-21ksoftirqd/021:10:000
163942994331,8cyclictest235-21systemd-journal23:49:170
163942994330,9cyclictest235-21systemd-journal20:22:170
163956994229,9cyclictest37-21ksoftirqd/322:40:013
163956994229,9cyclictest37-21ksoftirqd/322:40:003
163956994228,10cyclictest272-21dbus-daemon20:30:013
163956994227,11cyclictest235-21systemd-journal19:35:023
163947994225,12cyclictest235-21systemd-journal22:35:011
163942994236,3cyclictest16950irq/224-800000022:00:330
16394299423,16cyclictest179770-21sshd00:13:240
16395699415,11cyclictest37-21ksoftirqd/322:15:013
16395699414,7cyclictest131rcu_preempt00:40:003
163956994127,11cyclictest272-21dbus-daemon23:35:023
163956994127,11cyclictest272-21dbus-daemon20:05:023
163956994125,12cyclictest177955-21cron23:40:013
16394799415,5cyclictest131rcu_preempt19:15:001
163947994127,10cyclictest235-21systemd-journal23:45:171
163942994123,12cyclictest12-21ksoftirqd/000:20:000
16394299411,36cyclictest0-21swapper/019:50:480
163956994030,6cyclictest168818-21cron20:45:013
163956994030,6cyclictest164398-21sh19:20:003
163956994026,11cyclictest37-21ksoftirqd/320:20:003
163956994025,11cyclictest272-21dbus-daemon21:55:013
163956994022,13cyclictest37-21ksoftirqd/322:00:003
16395699401,5cyclictest131rcu_preempt23:50:013
16394299406,25cyclictest165434-21modprobe19:40:000
163942994026,10cyclictest12-21ksoftirqd/021:30:010
163942994026,10cyclictest12-21ksoftirqd/021:30:000
163942994024,12cyclictest235-21systemd-journal19:27:170
16394299402,33cyclictest177464-21munin-run23:30:000
16394299402,33cyclictest0-21swapper/023:55:000
16394299402,12cyclictest1-21systemd19:24:180
163942994021,14cyclictest272-21dbus-daemon20:50:000
163942994021,13cyclictest306-21in:imuxsock22:00:000
163942994019,14cyclictest171680-21modprobe21:40:000
16394299401,35cyclictest0-21swapper/020:10:000
16395699395,3cyclictest131rcu_preempt23:00:003
16395699394,4cyclictest131rcu_preempt22:20:023
16394799398,21cyclictest221rcuc/121:40:021
163947993929,6cyclictest169597-21sendmail21:00:001
163947993924,12cyclictest23-21ksoftirqd/121:15:011
163947993923,12cyclictest179253-21sshd00:00:181
163942993932,5cyclictest0-21swapper/023:20:010
163942993932,4cyclictest16850irq/134-800000021:00:010
163942993929,6cyclictest174583-21cron22:35:000
16394299392,6cyclictest181111-21munin-run00:40:000
163942993926,9cyclictest12-21ksoftirqd/023:45:010
163942993925,10cyclictest12-21ksoftirqd/023:10:010
163942993925,10cyclictest12-21ksoftirqd/021:25:020
163942993914,22cyclictest12-21ksoftirqd/019:35:030
163956993825,7cyclictest165703-21cron19:45:003
163956993824,11cyclictest37-21ksoftirqd/320:40:003
163956993822,10cyclictest272-21dbus-daemon23:15:003
163947993830,5cyclictest176414-21latency_hist23:10:001
163947993827,8cyclictest23-21ksoftirqd/122:45:011
163947993827,8cyclictest173532-21sshd22:13:181
163947993826,9cyclictest166167-21sed19:50:021
163942993833,3cyclictest16950irq/224-800000020:40:180
163942993829,5cyclictest171426-21sh21:34:590
163942993828,6cyclictest177713-21munin-plugin-st23:35:010
163942993827,7cyclictest165954-21cron19:50:010
16394299382,21cyclictest151rcuc/020:55:020
163942993815,18cyclictest272-21dbus-daemon00:30:010
163942993815,18cyclictest272-21dbus-daemon00:30:000
16394299381,32cyclictest408-21lldpd22:38:380
16394299381,32cyclictest408-21lldpd22:38:370
16395699373,3cyclictest131rcu_preempt19:15:003
163956993727,7cyclictest37-21ksoftirqd/322:10:033
163956993725,9cyclictest37-21ksoftirqd/319:50:033
163956993725,9cyclictest177433-21sshd23:26:163
163956993725,9cyclictest170007-21wc21:05:013
163956993724,10cyclictest37-21ksoftirqd/320:10:013
163956993723,10cyclictest235-21systemd-journal23:20:033
163956993723,10cyclictest235-21systemd-journal20:12:483
163956993711,21cyclictest173035-21cron22:05:003
163947993729,4cyclictest181104-21latency_hist00:40:001
163947993726,9cyclictest23-21ksoftirqd/122:10:011
163947993726,7cyclictest175874-21cron22:59:591
163947993725,8cyclictest23-21ksoftirqd/120:55:021
163947993723,11cyclictest23-21ksoftirqd/119:54:591
16394299376,23cyclictest168549-21modprobe20:40:000
16394299372,5cyclictest176166-21munin-run23:05:000
163942993722,7cyclictest306-21in:imuxsock21:20:010
163942993721,11cyclictest235-21systemd-journal22:50:000
163942993717,16cyclictest175606-21sshd22:52:170
16394299371,6cyclictest168301-21munin-run20:35:000
16395699363,4cyclictest131rcu_preempt23:20:013
163956993628,6cyclictest37-21ksoftirqd/321:42:183
163956993625,5cyclictest37-21ksoftirqd/323:04:593
163956993624,7cyclictest178718-21sshd23:50:163
163956993620,11cyclictest272-21dbus-daemon20:00:013
163956993619,13cyclictest1-21systemd00:30:013
163956993619,13cyclictest1-21systemd00:30:003
163956993619,12cyclictest1-21systemd23:45:013
16395699361,4cyclictest131rcu_preempt00:34:593
16395699361,3cyclictest131rcu_preempt00:05:013
163947993625,8cyclictest23-21ksoftirqd/120:50:011
163947993625,8cyclictest164353-21sshd19:15:181
163947993625,7cyclictest23-21ksoftirqd/123:35:031
163947993624,9cyclictest174333-21cron22:30:001
163947993623,10cyclictest1-21systemd00:30:011
163947993623,10cyclictest1-21systemd00:30:011
163942993620,12cyclictest1-21systemd20:15:010
163942993619,5cyclictest12-21ksoftirqd/020:15:170
16394299361,12cyclictest164278-21latency_hist19:15:010
16395699353,3cyclictest131rcu_preempt21:20:003
16395699352,3cyclictest131rcu_preempt22:25:013
163956993523,8cyclictest171177-21sh21:30:013
163956993523,8cyclictest171177-21sh21:30:003
163956993522,8cyclictest235-21systemd-journal19:20:033
163956993518,12cyclictest235-21systemd-journal19:35:023
16395699351,4cyclictest131rcu_preempt21:40:023
16395699351,30cyclictest168358-21wc20:35:013
16394799353,16cyclictest180509-21latency_hist00:25:011
163947993528,5cyclictest23-21ksoftirqd/100:15:031
163947993526,7cyclictest23-21ksoftirqd/120:10:021
163947993524,7cyclictest23-21ksoftirqd/122:05:001
163947993519,12cyclictest272-21dbus-daemon21:05:011
163947993516,14cyclictest1-21systemd22:20:011
163942993523,9cyclictest12-21ksoftirqd/021:55:010
163942993517,14cyclictest1-21systemd20:05:020
16394299351,31cyclictest0-21swapper/022:29:160
16394299351,31cyclictest0-21swapper/020:30:020
163956993427,4cyclictest170923-21latency_hist21:25:023
163956993424,8cyclictest37-21ksoftirqd/319:55:013
16395699342,3cyclictest131rcu_preempt19:30:013
163956993420,10cyclictest306-21in:imuxsock22:45:013
163956993419,11cyclictest272-21dbus-daemon00:20:013
16394799343,4cyclictest131rcu_preempt21:25:011
163947993427,5cyclictest178303-21latency_hist23:45:021
163947993426,5cyclictest176303-21latency_hist23:05:021
163947993422,9cyclictest23-21ksoftirqd/122:51:291
163947993420,11cyclictest167223-21sshd20:11:181
163947993420,10cyclictest272-21dbus-daemon20:45:001
163942993428,3cyclictest0-21swapper/000:30:200
16395699333,3cyclictest131rcu_preempt00:15:003
16395699332,3cyclictest131rcu_preempt22:30:003
163956993320,7cyclictest37-21ksoftirqd/322:55:013
163956993319,10cyclictest37-21ksoftirqd/320:45:023
16395699331,3cyclictest131rcu_preempt22:48:173
16395699331,3cyclictest131rcu_preempt00:25:023
16394799333,5cyclictest131rcu_preempt20:30:001
163947993324,5cyclictest306-21in:imuxsock23:22:171
163947993322,8cyclictest165443-21run-parts19:39:591
163947993321,9cyclictest23-21ksoftirqd/122:21:161
163947993320,10cyclictest23-21ksoftirqd/119:20:161
163947993319,10cyclictest178757-21systemd-run23:55:011
163942993326,4cyclictest19050irq/34-mmc121:11:440
16394299331,29cyclictest0-21swapper/000:23:290
163956993221,8cyclictest37-21ksoftirqd/322:34:173
163956993219,10cyclictest179683-21cat00:10:023
163956993218,11cyclictest37-21ksoftirqd/323:06:323
163947993225,4cyclictest180847-21munin-plugin-st00:35:001
163947993225,4cyclictest163961-21latency_hist19:10:011
163947993224,5cyclictest178045-21latency_hist23:40:011
163947993224,5cyclictest1-21systemd19:45:011
163947993221,9cyclictest23-21ksoftirqd/100:16:461
163947993221,8cyclictest167764-21sshd20:21:181
16394799321,4cyclictest131rcu_preempt21:09:591
16394799317,5cyclictest131rcu_preempt20:32:541
16394799314,3cyclictest131rcu_preempt21:35:011
16394799312,9cyclictest40850lldpd00:08:101
163956993020,7cyclictest37-21ksoftirqd/319:10:023
16394799303,3cyclictest131rcu_preempt23:20:011
16394799302,4cyclictest131rcu_preempt19:35:011
163947993023,4cyclictest175377-21latency_hist22:50:021
163947993019,8cyclictest172186-21sshd21:47:171
163947992917,7cyclictest0-21swapper/123:15:001
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional