You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-02 - 23:25

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack2slot7s.osadl.org (updated Fri May 02, 2025 12:41:39)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1675012995836,16cyclictest1749027-21sh10:10:010
1675012995635,16cyclictest0-21swapper/011:47:330
1675012995634,15cyclictest0-21swapper/009:27:270
1675012995226,17cyclictest12450irq/32-eth009:32:300
1675013995143,5cyclictest422-21dbus-daemon09:55:011
167501399513,34cyclictest1747508-21ssh10:07:231
1675012995133,13cyclictest1808100-21modprobe11:38:510
1675012995133,13cyclictest1808100-21modprobe11:38:510
1675012994938,8cyclictest12450irq/32-eth011:23:470
1675012994830,8cyclictest889984-21cups-browsed09:44:020
1675012994830,8cyclictest889984-21cups-browsed09:44:020
1675012994739,6cyclictest1740964-21kernelversion09:57:200
1675012994732,12cyclictest1701985-21latency_hist08:40:020
1675013994536,6cyclictest1735511-21tail09:47:371
1675013994536,6cyclictest1735511-21tail09:47:371
1675012994537,5cyclictest1675011-21cyclictest10:17:120
1675012994533,7cyclictest171rcu_preempt08:02:250
1675012994533,6cyclictest1751538-21sshd10:12:510
1675012994516,19cyclictest1770370-21ssh10:42:260
1675012994516,19cyclictest1770370-21ssh10:42:260
1675014994333,7cyclictest422-21dbus-daemon08:47:082
1675014994333,7cyclictest422-21dbus-daemon08:47:082
1675014994333,7cyclictest1778437-21cron10:55:012
167501499433,35cyclictest657-21snmpd08:22:282
167501299433,30cyclictest1821383-21ssh11:57:210
1675012994329,11cyclictest1855077-21ssh12:40:010
1675012994329,11cyclictest1855077-21ssh12:40:010
1675012994328,3cyclictest171rcu_preempt09:52:230
1675014994233,6cyclictest1855083-21munin-run12:40:012
1675014994233,6cyclictest1855083-21munin-run12:40:012
1675014994233,6cyclictest1815599-21cut11:50:012
1675014994233,6cyclictest1775125-21systemd-run10:50:012
1675014994233,6cyclictest1775125-21systemd-run10:50:012
1675012994235,4cyclictest1677991-21/usr/sbin/munin07:20:020
1675012994234,5cyclictest1710919-21diskmemload12:05:010
1675012994226,4cyclictest0-21swapper/010:40:010
1675012994226,4cyclictest0-21swapper/010:40:010
1675014994134,4cyclictest1684024-21latency_hist07:40:022
1675014994134,4cyclictest1684024-21latency_hist07:40:022
167501399415,33cyclictest1754037-21ssh10:17:241
1675013994133,5cyclictest1805041-21cron11:35:011
1675012994123,15cyclictest422-21dbus-daemon11:32:200
1675014994031,6cyclictest889984-21cups-browsed11:01:582
1675014994031,6cyclictest1703459-21true08:45:012
1675013994035,2cyclictest0-21swapper/107:20:011
1675013994032,5cyclictest1723843-21systemd-run09:30:021
1675013994032,3cyclictest0-21swapper/111:38:501
1675013994032,3cyclictest0-21swapper/111:38:501
1675013994031,5cyclictest1823321-21ssh12:00:011
1675012994033,4cyclictest1681062-21latency_hist07:30:020
1675014993933,3cyclictest0-21swapper/210:57:332
167501499393,30cyclictest1754137-21sh10:17:282
1675014993930,6cyclictest1713214-21systemctl09:12:302
1675014993930,6cyclictest1713214-21systemctl09:12:302
1675014993930,5cyclictest1823362-21sendmail12:00:012
1675014993927,9cyclictest266-21systemd-journal09:40:022
1675013993933,3cyclictest0-21swapper/109:40:011
1675013993932,3cyclictest0-21swapper/112:25:011
1675012993933,3cyclictest959-21mta-sts-daemon10:02:240
1675012993931,5cyclictest1765378-21systemd-run10:35:020
1675012993917,18cyclictest421-21avahi-daemon12:22:490
1675014993832,3cyclictest0-21swapper/209:17:202
1675014993830,5cyclictest0-21swapper/210:25:012
1675014993828,8cyclictest1798046-21sh11:25:022
1675014993827,7cyclictest1835468-21latency_hist12:15:032
1675013993830,5cyclictest422-21dbus-daemon09:25:021
1675013993829,6cyclictest1692982-21systemd-run08:10:021
167501299385,30cyclictest1799953-21ssh11:27:280
1675012993832,4cyclictest1839378-21latency_hist12:20:020
1675012993828,6cyclictest889984-21cups-browsed09:24:290
167501299382,17cyclictest1760463-21sh10:27:220
1675012993821,11cyclictest151ktimers/008:42:280
1675014993731,3cyclictest0-21swapper/209:00:012
1675014993731,3cyclictest0-21swapper/209:00:012
1675014993729,5cyclictest1731771-21ntp_offset09:42:272
1675014993729,5cyclictest1731771-21ntp_offset09:42:272
1675014993728,5cyclictest1752423-21latency_hist10:15:032
1675013993729,5cyclictest1742737-21cron10:00:011
167501299373,30cyclictest1776954-21ssh10:52:260
167501299372,28cyclictest1773623-21ssh10:47:240
167501299372,28cyclictest1773623-21ssh10:47:240
1675014993630,3cyclictest0-21swapper/211:40:022
1675014993630,3cyclictest0-21swapper/211:40:022
1675014993629,4cyclictest1831336-21latency_hist12:10:022
1675014993629,3cyclictest0-21swapper/210:40:002
1675014993629,3cyclictest0-21swapper/210:40:002
1675014993628,5cyclictest889984-21cups-browsed10:28:112
1675014993628,5cyclictest1845743-21timerwakeupswit12:27:342
1675013993630,3cyclictest0-21swapper/111:25:011
1675013993630,2cyclictest0-21swapper/108:00:011
1675013993629,3cyclictest0-21swapper/111:52:261
1675013993628,5cyclictest1716580-21threads09:17:311
1675013993628,5cyclictest1696488-21fschecks_count08:22:161
1675013993623,9cyclictest1829271-21needreboot12:07:171
1675012993627,5cyclictest12450irq/32-eth009:37:300
1675012993625,5cyclictest0-21swapper/012:25:090
1675012993613,17cyclictest422-21dbus-daemon11:17:240
167501299361,28cyclictest1789629-21ssh11:12:450
167501299361,10cyclictest0-21swapper/007:12:220
167501499354,21cyclictest1841214-21ssh12:22:182
167501499353,24cyclictest1722410-21ssh09:27:242
1675013993528,3cyclictest0-21swapper/108:40:011
1675013993527,5cyclictest1783890-21unixbench_singl11:02:321
1675013993527,5cyclictest1758011-21unixbench_singl10:22:351
167501299353,24cyclictest1833393-21ssh12:12:210
1675014993429,2cyclictest0-21swapper/207:20:012
1675014993428,3cyclictest0-21swapper/209:57:372
1675014993426,4cyclictest0-21swapper/211:42:312
1675013993426,5cyclictest1779784-21ssh10:57:151
1675013993424,6cyclictest421-21avahi-daemon09:07:161
1675013993424,6cyclictest421-21avahi-daemon09:07:161
1675013993423,8cyclictest1708753-21needreboot09:02:211
1675012993428,4cyclictest1695949-21sendmail08:20:010
167501299342,23cyclictest1817644-21ssh11:52:250
1675014993328,2cyclictest0-21swapper/209:25:012
1675014993327,3cyclictest0-21swapper/211:15:012
1675014993327,3cyclictest0-21swapper/209:10:002
1675014993327,3cyclictest0-21swapper/209:10:002
1675014993326,4cyclictest957-21mta-sts-daemon10:42:432
1675014993326,4cyclictest957-21mta-sts-daemon10:42:432
1675014993325,5cyclictest1825719-21sensors_fan12:02:302
1675014993325,5cyclictest1786944-21threads11:07:332
1675014993325,5cyclictest1726061-21unixbench_multi09:32:372
1675014993324,6cyclictest959-21mta-sts-daemon11:52:242
167501499331,23cyclictest1837356-21ssh12:17:222
1675013993328,2cyclictest0-21swapper/110:37:131
1675013993328,2cyclictest0-21swapper/110:37:131
1675013993327,3cyclictest0-21swapper/112:40:021
1675013993327,3cyclictest0-21swapper/112:40:021
1675013993327,3cyclictest0-21swapper/107:40:011
1675013993327,3cyclictest0-21swapper/107:40:011
1675013993326,3cyclictest0-21swapper/111:47:191
1675013993325,5cyclictest1801526-21cron11:30:011
1675013993325,5cyclictest1777382-21unixbench-2d10:52:331
1675013993325,5cyclictest1764333-21unixbench-2d10:32:351
1675013993325,5cyclictest0-21swapper/111:20:011
167501299334,5cyclictest0-21swapper/007:32:240
1675012993313,16cyclictest1734911-21ssh09:47:240
1675012993313,16cyclictest1734911-21ssh09:47:240
1675014993226,3cyclictest0-21swapper/212:32:272
1675013993225,4cyclictest1695946-21cron08:20:011
1675013993225,3cyclictest0-21swapper/112:32:321
1675013993222,7cyclictest889984-21cups-browsed07:27:241
1675013993222,6cyclictest1-21systemd08:35:011
1675013993220,9cyclictest1810827-21switchtime11:42:351
1675012993225,5cyclictest422-21dbus-daemon09:12:290
1675012993225,5cyclictest422-21dbus-daemon09:12:290
1675012993225,4cyclictest1758735-21cron10:25:010
1675012993224,5cyclictest1669686-21kworker/u8:2-xprtiod09:10:020
1675012993224,5cyclictest1669686-21kworker/u8:2-xprtiod09:10:020
1675012993224,4cyclictest1810834-21switchtime11:42:350
167501299322,21cyclictest1716166-21ssh09:17:190
1675012993217,10cyclictest266-21systemd-journal10:59:510
1675012993216,11cyclictest12450irq/32-eth012:07:190
1675014993125,3cyclictest0-21swapper/207:25:012
1675014993124,4cyclictest955-21mta-sts-daemon10:09:272
1675014993123,5cyclictest1764413-21unixbench_singl10:32:362
1675014993123,5cyclictest1739652-21cron09:55:012
1675014993123,5cyclictest1689940-21cron08:00:012
1675014993121,6cyclictest1710919-21diskmemload11:27:232
167501499311,23cyclictest1803414-21diskmemload11:32:242
1675013993126,2cyclictest0-21swapper/112:17:331
1675013993125,3cyclictest0-21swapper/111:15:011
1675013993125,3cyclictest0-21swapper/107:50:011
1675013993123,5cyclictest1694443-21sh08:15:011
1675013993122,6cyclictest453-21systemd-logind07:10:011
1675013993122,5cyclictest1745710-21sh10:05:011
1675013993121,7cyclictest1731651-21ntpq09:42:231
1675013993121,7cyclictest1731651-21ntpq09:42:231
1675013993119,9cyclictest1714188-21sh09:14:211
1675013993119,9cyclictest1714188-21sh09:14:211
1675013993113,15cyclictest271ktimers/110:12:261
167501399311,26cyclictest1770550-21ssh10:42:331
167501399311,26cyclictest1770550-21ssh10:42:331
1675012993124,4cyclictest1847993-21sh12:31:160
1675012993116,7cyclictest12450irq/32-eth011:02:230
1675012993112,15cyclictest1701909-21kworker/u8:11+rpciod08:57:280
1675012993112,15cyclictest1701909-21kworker/u8:11+rpciod08:57:280
167501499301,24cyclictest1734981-21ssh09:47:272
167501499301,24cyclictest1734981-21ssh09:47:272
1675013993024,3cyclictest0-21swapper/110:25:401
1675013993024,3cyclictest0-21swapper/109:32:271
1675013993022,5cyclictest1676442-21unixbench_singl07:12:341
167501299303,20cyclictest1786591-21ssh11:07:230
167501499292,19cyclictest1744575-21ssh10:02:262
1675013992920,6cyclictest1827488-21latency_hist12:05:031
167501299294,19cyclictest12450irq/32-eth008:52:260
167501299294,19cyclictest12450irq/32-eth008:52:260
1675012992923,4cyclictest1689854-21sed07:57:350
1675012992923,3cyclictest0-21swapper/008:15:010
1675012992911,13cyclictest422-21dbus-daemon07:42:210
167501499284,20cyclictest437-21mta-sts-daemon08:37:212
167501499283,21cyclictest1792957-21ssh11:17:282
1675014992821,4cyclictest1709147-21threads09:02:342
1675014992820,5cyclictest1686508-21proc_pri07:47:382
1675013992821,5cyclictest0-21swapper/112:12:301
1675012992822,4cyclictest1688357-21unixbench_multi07:52:370
1675012992821,5cyclictest1683895-21head07:37:340
1675012992821,5cyclictest1683895-21head07:37:340
1675012992821,4cyclictest1697392-21unixbench_singl08:22:350
1675014992720,4cyclictest957-21mta-sts-daemon08:15:012
1675014992717,8cyclictest889984-21cups-browsed08:17:332
167501499270,8cyclictest168400650kworker/u8:15+xprtiod08:27:342
1675013992721,3cyclictest0-21swapper/109:00:011
1675013992721,3cyclictest0-21swapper/109:00:011
1675013992721,3cyclictest0-21swapper/107:42:211
1675013992720,4cyclictest0-21swapper/111:07:231
1675013992720,3cyclictest0-21swapper/110:47:271
1675013992720,3cyclictest0-21swapper/110:47:271
1675012992721,4cyclictest1678414-21aten_r2power_vo07:22:110
1675012992717,7cyclictest889984-21cups-browsed08:47:080
1675012992717,7cyclictest889984-21cups-browsed08:47:080
1675014992617,6cyclictest1705236-21tail08:52:102
1675014992617,6cyclictest1705236-21tail08:52:102
1675014992614,8cyclictest1-21systemd08:10:022
1675013992620,3cyclictest0-21swapper/107:35:011
1675013992619,4cyclictest1706442-21systemd-run08:55:011
1675013992619,4cyclictest1706442-21systemd-run08:55:011
1675013992618,5cyclictest1804548-21kworker/u8:6-xprtiod12:27:111
1675013992617,6cyclictest1703972-21fschecks_time08:47:131
1675013992617,6cyclictest1703972-21fschecks_time08:47:131
1675012992619,4cyclictest1692955-21cron08:10:010
1675012992617,6cyclictest1700455-21systemd-run08:35:010
1675014992518,4cyclictest1679987-21sort07:27:132
1675014992515,7cyclictest889984-21cups-browsed07:11:082
1675013992517,5cyclictest959-21mta-sts-daemon08:42:251
1675012992520,3cyclictest1698900-21head08:27:340
1675014992417,4cyclictest0-21swapper/207:45:012
1675014992416,6cyclictest1691584-21kworker/u8:908:05:032
1675013992417,4cyclictest1691379-21unixbench_multi08:02:321
167501299243,15cyclictest437-21mta-sts-daemon09:02:250
167501399232,13cyclictest437-21mta-sts-daemon08:27:221
1675013992315,5cyclictest955-21mta-sts-daemon07:54:301
167501299230,3cyclictest171rcu_preempt07:47:380
1675014992213,6cyclictest955-21mta-sts-daemon07:52:222
1675014992115,3cyclictest0-21swapper/207:32:332
1675014992112,6cyclictest1699787-21netstat08:32:182
167501399202,13cyclictest1679064-21ps07:22:261
167501599192,6cyclictest0-21swapper/311:17:253
167501299190,16cyclictest1675071-21cat07:10:020
1675014991813,2cyclictest0-21swapper/207:10:022
167501599174,7cyclictest0-21swapper/312:12:253
167501599161,9cyclictest0-21swapper/312:37:253
167501599161,9cyclictest0-21swapper/312:37:253
167501599161,8cyclictest0-21swapper/309:42:233
167501599161,8cyclictest0-21swapper/309:42:233
167501599161,8cyclictest0-21swapper/309:32:233
167501599153,5cyclictest0-21swapper/309:17:203
167501599152,8cyclictest0-21swapper/311:38:483
167501599152,8cyclictest0-21swapper/311:38:483
167501599152,4cyclictest0-21swapper/311:12:473
167501599151,8cyclictest0-21swapper/310:42:323
167501599151,8cyclictest0-21swapper/310:42:323
167501599151,7cyclictest0-21swapper/312:02:193
167501599151,7cyclictest0-21swapper/309:47:313
167501599151,7cyclictest0-21swapper/309:47:313
167501599142,7cyclictest0-21swapper/312:32:253
167501599142,7cyclictest0-21swapper/310:57:273
167501599142,7cyclictest0-21swapper/310:17:123
167501599142,6cyclictest0-21swapper/311:57:203
167501599142,6cyclictest0-21swapper/309:22:303
167501599142,6cyclictest0-21swapper/308:37:243
167501599142,5cyclictest0-21swapper/307:22:223
167501599141,8cyclictest0-21swapper/311:02:253
167501599141,7cyclictest0-21swapper/311:42:313
167501599141,7cyclictest0-21swapper/311:07:273
167501599141,7cyclictest0-21swapper/309:52:273
167501599141,6cyclictest0-21swapper/308:57:253
167501599141,6cyclictest0-21swapper/308:57:253
167501599141,5cyclictest0-21swapper/307:32:203
167501599133,5cyclictest0-21swapper/309:02:253
167501599132,7cyclictest0-21swapper/310:27:223
167501599132,6cyclictest0-21swapper/311:27:133
167501599132,5cyclictest0-21swapper/309:07:193
167501599132,5cyclictest0-21swapper/309:07:193
167501599132,5cyclictest0-21swapper/308:17:213
167501599132,5cyclictest0-21swapper/308:02:223
167501599132,4cyclictest0-21swapper/308:42:243
167501599132,4cyclictest0-21swapper/308:12:193
167501599131,7cyclictest0-21swapper/312:27:273
167501599131,7cyclictest0-21swapper/312:17:243
167501599131,7cyclictest0-21swapper/312:07:223
167501599131,7cyclictest0-21swapper/311:23:473
167501599131,7cyclictest0-21swapper/310:12:273
167501599131,7cyclictest0-21swapper/309:57:253
167501599131,7cyclictest0-21swapper/309:37:333
167501599131,6cyclictest0-21swapper/308:22:233
167501599125,4cyclictest0-21swapper/310:07:243
167501599124,5cyclictest0-21swapper/309:15:013
167501599124,5cyclictest0-21swapper/309:15:013
167501599122,6cyclictest0-21swapper/310:52:153
167501599122,6cyclictest0-21swapper/310:02:113
167501599122,6cyclictest0-21swapper/309:27:143
167501599122,5cyclictest0-21swapper/307:17:203
167501599121,8cyclictest0-21swapper/310:32:283
167501599121,7cyclictest0-21swapper/312:22:183
167501599121,7cyclictest0-21swapper/311:52:153
167501599121,7cyclictest0-21swapper/310:47:323
167501599121,7cyclictest0-21swapper/310:47:323
167501599121,6cyclictest0-21swapper/311:47:203
167501599121,6cyclictest0-21swapper/307:12:243
167501599121,5cyclictest0-21swapper/308:27:223
167501599121,5cyclictest0-21swapper/307:37:243
167501599121,5cyclictest0-21swapper/307:37:243
167501599113,6cyclictest0-21swapper/308:07:233
167501599112,4cyclictest0-21swapper/310:35:543
167501599112,4cyclictest0-21swapper/310:35:543
167501599111,6cyclictest0-21swapper/311:32:133
167501599111,6cyclictest0-21swapper/310:22:203
167501599111,6cyclictest0-21swapper/307:57:253
167501599111,5cyclictest0-21swapper/308:47:183
167501599111,5cyclictest0-21swapper/308:47:183
167501599111,5cyclictest0-21swapper/307:52:253
167501599102,5cyclictest0-21swapper/307:27:323
167501599101,5cyclictest0-21swapper/308:32:203
167501599101,5cyclictest0-21swapper/307:47:313
16750159993,4cyclictest0-21swapper/307:10:023
16750159992,4cyclictest0-21swapper/308:52:243
16750159992,4cyclictest0-21swapper/308:52:243
16750159991,5cyclictest0-21swapper/307:42:213
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional