You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-10 - 08:08

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot3s.osadl.org (updated Wed Dec 10, 2025 00:45:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1794532998150,23cyclictest48-21kcompactd000:10:012
179452199773,27cyclictest1807166-21sshd23:13:410
179452199773,27cyclictest1807166-21sshd23:13:400
179452199751,69cyclictest1796763-21sshd19:51:400
179453299725,53cyclictest0-21swapper/222:30:022
1794529997033,33cyclictest1804848-21cron22:30:011
179453699694,17cyclictest131rcu_preempt00:20:013
179453699684,20cyclictest1799658-21munin-plugin-st20:50:003
179453699684,20cyclictest1799658-21munin-plugin-st20:50:003
179453699675,16cyclictest1804611-21cut22:25:003
1794521996726,37cyclictest12-21ksoftirqd/021:55:010
179452199664,14cyclictest1804610-21grep22:25:000
1794521996623,4cyclictest0-21swapper/023:48:400
179452999642,13cyclictest1808245-21munin-run23:35:011
179453699636,18cyclictest1810199-21grep00:10:023
1794536996322,35cyclictest1809533-40ogrotate00:00:013
179452999632,15cyclictest1811431-21munin-run00:35:001
179452999632,14cyclictest1804042-21sshd22:12:401
179452999631,13cyclictest363-21snmpd19:40:491
179452199632,56cyclictest0-21swapper/022:02:400
179452999622,15cyclictest1809807-21munin-run00:04:591
1794529996212,44cyclictest272-21dbus-daemon00:15:001
179452199621,24cyclictest0-21swapper/022:05:500
179452999612,6cyclictest1805899-21munin-run22:50:021
179452999612,6cyclictest1805899-21munin-run22:50:011
179452999612,16cyclictest861385-21sendmail-mta19:25:251
1794529996118,39cyclictest1-21systemd20:10:001
1794529996113,43cyclictest0-21swapper/123:51:561
179452999611,14cyclictest1798640-21munin-run20:30:011
179452999611,14cyclictest1795223-21sshd19:20:401
179452999611,13cyclictest1808493-21munin-run23:40:001
179452999611,13cyclictest1808493-21munin-run23:40:001
1794521996122,11cyclictest1-21systemd21:25:000
1794521996118,11cyclictest1-21systemd20:55:000
179452199611,4cyclictest1795488-21sshd19:28:400
179453699606,15cyclictest1806393-21modprobe23:00:003
1794529996032,25cyclictest1796596-21sed19:50:021
179452999602,9cyclictest1801195-21sshd21:19:401
1794529996012,12cyclictest272-21dbus-daemon22:20:011
179452999601,14cyclictest363-21snmpd21:48:191
179452199603,20cyclictest235-21systemd-journal21:09:590
1794521996026,30cyclictest1800646-21latency_hist21:05:020
1794521996015,12cyclictest1806390-21cron23:00:000
179452199601,19cyclictest1799662-21munin-plugin-st20:50:000
179452199601,19cyclictest1799662-21munin-plugin-st20:50:000
1794532995922,8cyclictest1800703-21/usr/sbin/munin21:10:002
179452999592,18cyclictest1806686-21cut23:05:011
179452999592,18cyclictest1806686-21cut23:05:001
179452199593,15cyclictest1798627-21modprobe20:30:000
1794521995919,9cyclictest272-21dbus-daemon22:45:020
179452199591,26cyclictest0-21swapper/020:01:450
1794536995818,9cyclictest0-21swapper/319:15:023
179452999582,21cyclictest1797327-21latency_hist20:05:001
179452999582,15cyclictest1799912-21munin-run20:55:001
179452999582,13cyclictest412-21sshd20:39:391
179452999582,12cyclictest363-21snmpd22:06:201
1794529995813,40cyclictest0-21swapper/120:41:521
179452999581,15cyclictest1795860-21latency_hist19:35:021
179452999581,11cyclictest363-21snmpd20:17:521
1794521995831,23cyclictest272-21dbus-daemon00:15:010
1794521995827,27cyclictest12-21ksoftirqd/020:00:010
1794521995813,11cyclictest272-21dbus-daemon20:35:010
1794521995813,11cyclictest272-21dbus-daemon20:35:010
179453699575,21cyclictest1798628-21munin-run20:30:003
1794532995738,15cyclictest1800931-21sshd21:13:392
179452999576,4cyclictest0-21swapper/122:41:011
179452999573,12cyclictest1807730-21munin-plugin-st23:25:001
1794529995729,19cyclictest1794515-21cyclictest00:25:021
1794529995724,29cyclictest1809013-21latency_hist23:50:021
179452999572,15cyclictest1801998-21munin-run21:35:011
179452999572,13cyclictest1794663-21cat19:10:021
1794529995720,32cyclictest23-21ksoftirqd/120:25:001
1794529995718,34cyclictest1802253-21latency_hist21:40:021
1794529995718,33cyclictest1803248-21sshd21:55:401
1794521995747,5cyclictest16950irq/224-800000000:35:000
179452199572,7cyclictest1809548-21sendmail-msp00:00:010
179452199571,52cyclictest0-21swapper/023:25:030
179452999565,5cyclictest1810661-21munin-run00:20:011
179452999562,8cyclictest1807202-21munin-run23:15:011
179452999562,8cyclictest1807202-21munin-run23:15:011
179452999562,6cyclictest1-21systemd23:10:011
179452999562,12cyclictest1804631-21wc22:25:011
179452999562,11cyclictest1794730-21munin-run19:15:011
1794529995617,34cyclictest272-21dbus-daemon21:00:011
179452999561,12cyclictest363-21snmpd20:31:221
179452999561,12cyclictest363-21snmpd20:31:221
179452199566,9cyclictest12-21ksoftirqd/020:15:000
1794521995618,13cyclictest272-21dbus-daemon00:10:000
179452199561,12cyclictest1811680-21munin-run00:40:000
179452999552,16cyclictest1794992-21modprobe19:20:001
179452999551,13cyclictest1810120-21latency_hist00:10:021
179452999551,12cyclictest1801746-21munin-run21:30:001
179452999551,11cyclictest281-21systemd-logind21:45:011
179452999551,10cyclictest363-21snmpd23:41:421
1794521995525,9cyclictest12-21ksoftirqd/021:40:020
1794521995522,3cyclictest0-21swapper/019:31:400
1794521995518,6cyclictest1794817-21grep19:15:020
179452999547,3cyclictest0-21swapper/122:38:081
179452999542,9cyclictest1797086-21true20:00:011
179452999542,6cyclictest1800940-21cron21:15:001
1794529995421,30cyclictest23-21ksoftirqd/121:52:071
1794529995412,36cyclictest0-21swapper/100:00:011
179452999541,12cyclictest363-21snmpd21:00:521
179452999541,12cyclictest363-21snmpd21:00:521
179452999541,10cyclictest363-21snmpd22:01:171
179452199544,18cyclictest1807949-21sshd23:26:400
1794532995337,13cyclictest1798069-21sshd20:17:402
179452999532,12cyclictest1805083-21sshd22:32:141
179452999531,6cyclictest1797821-21cron20:15:001
1794521995320,9cyclictest1801154-21sed21:15:030
1794536995234,14cyclictest1-21systemd23:25:023
1794532995239,9cyclictest48-21kcompactd022:21:592
1794532995226,21cyclictest1805122-21systemd-run22:35:012
179452999528,3cyclictest0-21swapper/122:55:281
179452999523,5cyclictest412-21sshd22:53:401
1794529995225,22cyclictest1-21systemd19:40:011
179452999521,13cyclictest1799639-21sshd20:48:411
179452999521,13cyclictest1799639-21sshd20:48:401
179452999521,11cyclictest363-21snmpd00:22:321
1794521995223,9cyclictest12-21ksoftirqd/021:50:000
1794521995223,24cyclictest19050irq/34-mmc123:10:010
1794521995221,5cyclictest1794982-21sendmail19:20:000
1794521995218,8cyclictest12-21ksoftirqd/021:20:020
1794536995132,14cyclictest272-21dbus-daemon23:40:013
1794536995132,14cyclictest272-21dbus-daemon23:40:003
1794532995142,5cyclictest1802752-21sshd21:47:062
1794532995142,4cyclictest1810546-21apt-get00:16:222
1794532995138,10cyclictest1795240-21sshd19:24:402
1794532995137,11cyclictest1807814-21cat23:25:012
1794532995137,10cyclictest363-21snmpd19:50:502
1794532995137,10cyclictest1810871-21sshd00:22:402
1794532995136,11cyclictest363-21snmpd20:05:542
1794532995136,11cyclictest1801255-21munin-run21:20:012
1794532995136,11cyclictest1798892-21munin-run20:35:012
1794532995136,11cyclictest1798892-21munin-run20:35:012
1794532995134,11cyclictest235-21systemd-journal22:05:002
179452999512,9cyclictest235-21systemd-journal00:40:011
179452999511,11cyclictest363-21snmpd23:25:091
1794521995120,27cyclictest0-21swapper/019:10:010
1794521995115,10cyclictest12-21ksoftirqd/000:20:000
1794536995032,13cyclictest1-21systemd20:45:013
1794532995038,8cyclictest48-21kcompactd019:30:072
1794532995035,12cyclictest1802997-21sshd21:50:402
1794532995035,11cyclictest1806903-21sshd23:06:402
1794532995033,11cyclictest1803815-21munin-run22:10:002
1794532995030,16cyclictest1807959-21sshd23:28:412
179452999505,9cyclictest0-21swapper/123:20:011
1794521995029,15cyclictest1-21systemd22:40:000
1794521995015,8cyclictest1807461-21modprobe23:20:000
179452199501,20cyclictest1799547-21grep20:45:030
1794536994931,13cyclictest235-21systemd-journal00:30:003
1794532994937,9cyclictest1807159-21sshd23:12:302
1794532994937,9cyclictest1807159-21sshd23:12:292
1794532994936,9cyclictest48-21kcompactd020:42:532
1794532994936,10cyclictest1811634-21sshd00:35:402
1794532994936,10cyclictest1802531-21munin-run21:45:012
1794532994936,10cyclictest1800420-21sshd21:03:412
1794532994936,10cyclictest1800420-21sshd21:03:402
1794532994935,10cyclictest1797848-21munin-run20:15:022
1794532994934,12cyclictest1808746-21sshd23:44:392
1794532994922,23cyclictest1-21systemd00:30:002
179452999493,7cyclictest1800691-21modprobe21:10:001
179452999492,11cyclictest363-21snmpd21:21:091
179452999491,9cyclictest363-21snmpd19:51:111
1794532994840,5cyclictest363-21snmpd00:31:532
1794532994839,5cyclictest1806444-21munin-run23:00:022
1794532994836,9cyclictest363-21snmpd00:01:472
1794532994836,9cyclictest1807431-21sshd23:19:392
1794532994835,9cyclictest48-21kcompactd022:19:452
1794532994835,9cyclictest48-21kcompactd021:59:092
1794532994835,9cyclictest48-21kcompactd020:23:242
1794532994835,10cyclictest1805409-21munin-run22:40:002
1794532994835,10cyclictest1799624-21sshd20:45:412
1794532994835,10cyclictest1799624-21sshd20:45:402
1794532994834,10cyclictest1808991-21sshd23:47:412
1794532994833,11cyclictest363-21snmpd20:36:002
1794532994829,15cyclictest363-21snmpd19:47:232
1794532994827,16cyclictest363-21snmpd19:43:292
1794532994826,18cyclictest1801496-21sh21:25:002
1794532994739,5cyclictest30-21ksoftirqd/219:15:402
1794532994738,6cyclictest1804080-21munin-run22:15:012
1794532994736,7cyclictest1795475-21sshd19:25:402
1794532994735,9cyclictest48-21kcompactd020:27:512
1794532994734,9cyclictest48-21kcompactd021:39:052
1794532994734,9cyclictest363-21snmpd20:04:302
1794532994734,9cyclictest1801720-21sshd21:27:402
1794532994732,10cyclictest363-21snmpd23:58:462
1794532994731,12cyclictest1799894-21sshd20:54:402
179452199471,27cyclictest0-21swapper/023:42:080
179452199471,26cyclictest0-21swapper/019:47:290
1794536994632,10cyclictest235-21systemd-journal21:20:033
1794536994631,11cyclictest37-21ksoftirqd/319:45:023
1794532994636,7cyclictest1808526-21munin-run23:40:012
1794532994636,7cyclictest1808526-21munin-run23:40:012
1794532994634,9cyclictest1806126-21sshd22:52:402
1794532994630,11cyclictest363-21snmpd23:51:492
179452199465,9cyclictest1808489-21cat23:40:010
179452199465,9cyclictest1808489-21cat23:40:000
1794521994622,4cyclictest0-21swapper/020:07:270
179452199461,29cyclictest0-21swapper/022:27:030
1794536994526,14cyclictest272-21dbus-daemon22:40:003
1794532994531,9cyclictest363-21snmpd22:48:062
1794532994531,9cyclictest363-21snmpd22:48:052
1794532994531,9cyclictest363-21snmpd19:59:382
1794521994537,4cyclictest16950irq/224-800000023:35:000
1794521994522,4cyclictest0-21swapper/019:37:140
1794521994517,24cyclictest12-21ksoftirqd/021:35:020
179452199451,26cyclictest0-21swapper/023:51:250
1794536994426,13cyclictest1-21systemd23:15:023
1794536994426,13cyclictest1-21systemd23:15:013
1794532994431,10cyclictest363-21snmpd19:10:422
1794521994430,10cyclictest16950irq/224-800000023:02:400
1794521994430,10cyclictest16950irq/224-800000023:02:400
179452199441,26cyclictest0-21swapper/020:16:350
1794536994333,8cyclictest37-21ksoftirqd/321:20:023
1794536994318,19cyclictest272-21dbus-daemon22:20:023
1794532994335,4cyclictest1810289-21sshd00:13:412
1794532994330,9cyclictest363-21snmpd23:30:062
1794532994330,9cyclictest363-21snmpd23:04:052
1794532994330,9cyclictest363-21snmpd23:04:052
1794532994325,14cyclictest363-21snmpd19:37:202
179452199436,9cyclictest0-21swapper/022:55:000
1794536994227,11cyclictest235-21systemd-journal22:05:013
1794532994229,10cyclictest363-21snmpd21:31:532
1794532994228,10cyclictest363-21snmpd22:43:222
1794521994226,12cyclictest1-21systemd19:45:020
1794521994222,4cyclictest0-21swapper/022:48:350
1794521994222,4cyclictest0-21swapper/022:48:350
179452199421,4cyclictest0-21swapper/000:01:050
179452199421,26cyclictest0-21swapper/020:37:590
179453699413,32cyclictest235-21systemd-journal22:45:013
1794536994125,12cyclictest37-21ksoftirqd/322:10:003
1794536994124,10cyclictest306-21in:imuxsock20:55:013
1794532994127,10cyclictest363-21snmpd20:56:042
1794521994130,6cyclictest1800167-21sendmail21:00:000
1794521994123,13cyclictest272-21dbus-daemon22:15:000
1794521994122,4cyclictest0-21swapper/021:27:390
1794521994110,21cyclictest12-21ksoftirqd/000:25:020
179453699403,4cyclictest131rcu_preempt23:09:593
1794536994029,9cyclictest37-21ksoftirqd/323:35:013
1794536994028,10cyclictest37-21ksoftirqd/321:40:023
1794536994023,12cyclictest235-21systemd-journal20:35:003
1794536994023,12cyclictest235-21systemd-journal20:35:003
1794536994016,17cyclictest1797583-21munin-plugin-st20:10:013
179453699401,4cyclictest1795006-21sendmail-msp19:20:003
1794521994026,9cyclictest235-21systemd-journal21:43:400
179452199401,5cyclictest1803293-21munin-run22:00:000
1794536993927,9cyclictest37-21ksoftirqd/322:55:023
1794536993927,9cyclictest37-21ksoftirqd/321:00:003
1794536993927,10cyclictest37-21ksoftirqd/322:15:013
1794536993926,8cyclictest37-21ksoftirqd/322:00:023
1794536993922,12cyclictest272-21dbus-daemon00:25:013
1794536993919,15cyclictest1-21systemd23:20:003
179453699391,6cyclictest131rcu_preempt20:25:013
1794532993920,15cyclictest1794460-21latency_hist19:10:032
1794521993910,6cyclictest131rcu_preempt20:25:010
179453699387,7cyclictest37-21ksoftirqd/322:27:133
179453699385,27cyclictest1797049-21modprobe20:00:003
1794536993828,6cyclictest306-21in:imuxsock23:05:003
1794536993828,6cyclictest306-21in:imuxsock23:05:003
1794536993827,5cyclictest1811437-21latency_hist00:35:003
1794536993826,5cyclictest306-21in:imuxsock21:35:013
1794536993824,10cyclictest0-21swapper/323:50:013
1794536993823,11cyclictest0-21swapper/320:40:003
1794536993727,8cyclictest37-21ksoftirqd/321:10:013
1794536993727,7cyclictest37-21ksoftirqd/319:55:023
1794536993723,10cyclictest235-21systemd-journal00:40:003
1794536993722,11cyclictest272-21dbus-daemon21:05:023
1794536993722,11cyclictest272-21dbus-daemon21:05:013
1794521993717,15cyclictest272-21dbus-daemon21:05:010
179452199371,4cyclictest131rcu_preempt22:35:010
179453699365,25cyclictest235-21systemd-journal21:40:013
179453699365,24cyclictest1796015-21latency_hist19:40:003
1794536993626,8cyclictest37-21ksoftirqd/322:50:023
1794536993626,8cyclictest37-21ksoftirqd/322:50:023
1794536993625,6cyclictest1795748-21cron19:35:003
179452199369,23cyclictest0-21swapper/019:22:020
1794521993621,11cyclictest235-21systemd-journal22:20:010
179453699358,20cyclictest1795511-21munin-plugin-st19:30:013
179453699357,20cyclictest1809259-21modprobe23:55:003
179453699355,22cyclictest1805113-21munin-run22:35:003
179453699354,22cyclictest1802774-21modprobe21:50:003
1794536993526,7cyclictest37-21ksoftirqd/323:30:003
1794536993525,7cyclictest1809789-21sshd00:04:403
1794536993521,10cyclictest37-21ksoftirqd/320:15:003
179452199353,3cyclictest131rcu_preempt00:25:030
1794536993424,8cyclictest37-21ksoftirqd/321:26:403
1794536993424,6cyclictest306-21in:imuxsock20:20:013
1794536993422,9cyclictest1795466-21sed19:25:023
179453699341,29cyclictest48-21kcompactd023:40:123
179453699332,4cyclictest131rcu_preempt21:15:013
1794536993322,9cyclictest37-21ksoftirqd/300:15:013
179453699332,25cyclictest1803033-21munin-run21:55:013
1794536993312,16cyclictest272-21dbus-daemon20:05:013
1794536993222,6cyclictest1794604-21cat19:10:023
1794536993219,10cyclictest37-21ksoftirqd/319:50:003
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional