You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-02 - 08:19

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot6s.osadl.org (updated Sun Aug 02, 2026 00:44:46)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1681013998428,26cyclictest22-21rcuc/119:15:011
168101899836,56cyclictest1693067-21apt-get20:20:022
1681018997032,33cyclictest1730636-21grep23:55:302
1681018996628,32cyclictest0-21swapper/219:45:272
1681018996427,27cyclictest0-21swapper/221:35:302
1681018996335,20cyclictest1727238-21grep23:35:292
1681018996120,38cyclictest1682910-21sshd19:16:022
1681018996016,36cyclictest0-21swapper/223:05:222
168101899601,51cyclictest1683157-21apt-get19:20:162
168101899601,51cyclictest1683157-21apt-get19:20:162
1681018995915,35cyclictest0-21swapper/220:20:022
1681018995819,30cyclictest0-21swapper/220:40:252
1681009995837,10cyclictest15-21rcuc/000:05:000
168101899572,47cyclictest1732641-21/usr/sbin/munin00:10:282
168101899572,47cyclictest1726102-21meminfo23:30:252
168101899572,46cyclictest1718213-21apt-get22:45:152
168101899572,46cyclictest1707904-21apt-get21:45:172
1681018995718,29cyclictest0-21swapper/219:35:222
168101899565,38cyclictest1711784-21ptp4l22:05:272
168101899561,12cyclictest1722424-21apt-get23:10:172
1681013995639,12cyclictest0-21swapper/119:35:261
168101899553,41cyclictest1735365-21fschecks_time00:25:212
1681018995530,19cyclictest0-21swapper/223:45:002
168101899551,45cyclictest1695896-21/usr/sbin/munin20:35:282
1681009995546,6cyclictest1734127-21munin-plugin-st00:20:010
168100999551,15cyclictest0-21swapper/023:15:200
168101899543,39cyclictest1734022-21grep00:15:292
1681018995425,20cyclictest0-21swapper/223:45:282
168101899541,12cyclictest1695053-21sshd20:30:022
168101899541,12cyclictest1695053-21sshd20:30:012
1681009995445,5cyclictest1737520-21cut00:40:000
168101899539,36cyclictest0-21swapper/200:30:172
168101899535,38cyclictest0-21swapper/222:00:302
168101899535,38cyclictest0-21swapper/222:00:302
168101899533,41cyclictest1732383-21head00:05:332
1681018995327,21cyclictest0-21swapper/223:00:012
1681018995314,33cyclictest1686721-21sh19:40:242
1681018995313,32cyclictest0-21swapper/222:30:022
1681018995313,31cyclictest0-21swapper/221:05:122
1681013995333,15cyclictest231ktimers/119:30:101
168101899526,38cyclictest0-21swapper/219:55:282
168101899522,42cyclictest1719051-21apt-get22:50:152
168101899522,40cyclictest1713616-21grep22:15:302
168101899522,39cyclictest1685184-21/usr/sbin/munin19:30:252
168101899521,8cyclictest1712372-21fschecks_time22:10:202
1681018995214,30cyclictest0-21swapper/221:10:212
168101899521,42cyclictest1690240-21cut20:00:262
1681018995214,29cyclictest0-21swapper/221:25:222
168101899521,10cyclictest1707065-21apt-get21:40:152
1681009995241,5cyclictest20650irq/252-8000000.ethernet20:50:300
168100999521,39cyclictest20850irq/208-8000000.ethernet22:00:200
168100999521,39cyclictest20850irq/208-8000000.ethernet22:00:200
168101899515,37cyclictest0-21swapper/223:50:272
168101899515,30cyclictest1708528-21kworker/u8:1+flush-179:9621:50:072
1681018995125,20cyclictest0-21swapper/223:00:212
1681018995125,20cyclictest0-21swapper/223:00:212
168101899512,40cyclictest1703624-21latency_hist21:20:012
1681018995116,28cyclictest0-21swapper/221:30:222
168101899511,10cyclictest1697690-21ssh20:45:202
168101899510,41cyclictest1710203-21unixbench_multi21:55:292
168101899502,9cyclictest1737456-21grep00:35:302
1681018995026,17cyclictest0-21swapper/222:35:222
168101899502,41cyclictest1724125-21apt-get23:20:182
168101899502,38cyclictest1723838-21grep23:15:302
168101899502,12cyclictest1690810-21df_inode20:05:172
168101899501,7cyclictest1681686-21/usr/sbin/munin19:10:292
168101899501,42cyclictest0-21swapper/222:40:212
1681018995011,33cyclictest1714077-21sh22:20:212
168100999501,17cyclictest0-21swapper/019:40:010
168101899494,37cyclictest1700278-21grep21:00:202
168101899493,13cyclictest1734498-21fschecks_time00:20:202
168101899492,9cyclictest1698763-21phc2sys20:50:272
168101899491,41cyclictest1715842-21tune2fs22:30:222
1681013994940,5cyclictest1727288-21munin-plugin-st23:40:001
1681009994931,13cyclictest131ktimers/023:35:130
168101899483,38cyclictest1694377-21sh20:25:212
168101899483,37cyclictest1691586-21apt-get20:10:192
168101899483,37cyclictest0-21swapper/220:55:212
1681018994820,21cyclictest0-21swapper/219:25:242
1681009994837,6cyclictest20650irq/252-8000000.ethernet21:40:000
1681009994817,27cyclictest0-21swapper/021:05:200
168101899472,4cyclictest1703945-21irqstats21:20:222
168101899472,4cyclictest1703945-21irqstats21:20:222
168101899472,36cyclictest1688308-21cut19:50:202
1681013994740,4cyclictest1712002-21apt22:09:591
1681013994738,5cyclictest1711166-21munin-plugin-st22:05:011
1681013994738,5cyclictest1711166-21munin-plugin-st22:05:011
168100999471,3cyclictest0-21swapper/020:55:180
168101899461,3cyclictest1731216-21/usr/sbin/munin00:00:242
168101399464,15cyclictest1703378-21apt-get21:20:021
168101399464,15cyclictest1703378-21apt-get21:20:011
1681013994628,15cyclictest231ktimers/120:15:151
168101899454,34cyclictest1725558-21grep23:25:272
168101899452,4cyclictest1681156-21latency_hist19:10:012
1681009994541,2cyclictest0-21swapper/020:00:010
1681009994539,3cyclictest167350irq/118-8000000.ethernet-tx020:00:230
1681009994536,4cyclictest1716661-21sh22:35:230
1681009994535,6cyclictest1700655-21grep21:00:270
1681013994436,5cyclictest0-21swapper/121:34:591
1681013994436,4cyclictest1691348-21grep20:05:291
1681013994435,4cyclictest0-21swapper/123:25:281
1681013994430,9cyclictest0-21swapper/123:45:291
1681013994430,9cyclictest0-21swapper/100:05:331
1681009994337,3cyclictest167350irq/118-8000000.ethernet-tx020:30:150
1681009994337,3cyclictest167350irq/118-8000000.ethernet-tx020:30:140
1681009994336,4cyclictest20650irq/252-8000000.ethernet19:20:180
1681009994336,4cyclictest20650irq/252-8000000.ethernet19:20:180
168100999431,4cyclictest0-21swapper/020:45:010
1681013994228,9cyclictest0-21swapper/120:20:211
1681009994236,4cyclictest0-21swapper/022:55:120
1681009994236,3cyclictest167350irq/118-8000000.ethernet-tx000:10:120
1681009994235,4cyclictest20650irq/252-8000000.ethernet23:55:250
1681009994234,4cyclictest167350irq/118-8000000.ethernet-tx023:40:230
168100999422,5cyclictest1704581-21df21:25:160
168100999421,9cyclictest0-21swapper/023:25:010
168100999421,35cyclictest0-21swapper/000:10:020
1681013994128,7cyclictest1660-21snmpd22:25:281
1681013994127,7cyclictest0-21swapper/100:20:291
168100999415,2cyclictest0-21swapper/022:30:190
1681009994135,3cyclictest20650irq/252-8000000.ethernet22:30:000
1681009994134,4cyclictest20650irq/252-8000000.ethernet22:20:240
1681009994134,4cyclictest20650irq/252-8000000.ethernet21:55:000
1681009994133,5cyclictest0-21swapper/021:20:000
168100999411,4cyclictest1684951-21ssh19:30:180
1681013994027,10cyclictest1706850-21munin-plugin-st21:40:001
1681009994033,4cyclictest20650irq/252-8000000.ethernet19:50:180
1681009994033,4cyclictest0-21swapper/020:25:160
1681009994033,3cyclictest1725555-21unixbench_singl23:25:280
1681009994032,4cyclictest0-21swapper/021:40:130
1681009994027,10cyclictest15-21rcuc/020:45:150
168100999402,6cyclictest1702622-21ls21:15:010
1681009994017,21cyclictest0-21swapper/019:10:280
1681013993933,3cyclictest1696538-21sendmail20:40:001
1681013993932,4cyclictest1694857-21munin-plugin-st20:30:001
1681013993931,5cyclictest1731606-21munin-plugin-st00:05:001
168100999396,2cyclictest0-21swapper/021:20:280
168100999396,2cyclictest0-21swapper/021:20:280
1681009993932,4cyclictest0-21swapper/019:45:220
1681009993928,7cyclictest1718805-21grep22:45:300
1681009993928,2cyclictest0-21swapper/019:15:170
1681009993923,14cyclictest0-21swapper/022:40:170
1681009993921,15cyclictest1693100-21apt-config20:20:000
168100999391,36cyclictest0-21swapper/021:45:150
168100999391,35cyclictest1713640-21unixbench_singl22:15:300
168100999391,2cyclictest0-21swapper/019:10:000
1681013993828,7cyclictest1698434-21/usr/sbin/munin20:50:181
1681013993825,9cyclictest1660-21snmpd21:00:091
1681013993825,6cyclictest0-21swapper/121:15:301
1681013993823,8cyclictest231ktimers/121:30:001
1681013993818,15cyclictest231ktimers/121:10:131
1681013993812,15cyclictest231ktimers/122:50:121
1681013993811,15cyclictest231ktimers/119:20:131
1681013993811,15cyclictest231ktimers/119:20:131
1681009993832,3cyclictest1712856-21latency_hist22:15:010
1681009993831,4cyclictest20650irq/252-8000000.ethernet19:40:150
1681009993830,5cyclictest0-21swapper/022:55:010
1681009993829,4cyclictest1711554-21tune2fs22:05:220
1681013993728,4cyclictest0-21swapper/121:40:281
1681013993727,6cyclictest1730692-21grep23:55:301
1681013993727,6cyclictest1687904-21grep19:45:281
168101399371,30cyclictest1721583-21/usr/sbin/munin23:05:251
168100999373,4cyclictest0-21swapper/023:55:010
1681009993731,3cyclictest20650irq/252-8000000.ethernet23:00:120
1681009993731,3cyclictest20650irq/252-8000000.ethernet23:00:110
1681009993730,4cyclictest167350irq/118-8000000.ethernet-tx000:25:150
1681009993721,14cyclictest0-21swapper/023:13:520
168100999371,34cyclictest0-21swapper/019:25:280
1681013993628,4cyclictest0-21swapper/123:30:301
1681013993623,9cyclictest231ktimers/122:10:121
1681009993630,4cyclictest20850irq/208-8000000.ethernet23:45:190
1681009993629,5cyclictest0-21swapper/020:40:000
1681009993629,4cyclictest20650irq/252-8000000.ethernet21:30:170
1681009993629,4cyclictest167350irq/118-8000000.ethernet-tx023:05:140
1681009993628,4cyclictest0-21swapper/000:30:280
1681009993620,7cyclictest0-21swapper/020:10:020
168100999361,3cyclictest0-21swapper/000:25:010
1681013993527,5cyclictest0-21swapper/120:00:161
1681013993526,6cyclictest1713604-21grep22:15:281
1681013993526,4cyclictest0-21swapper/123:15:011
1681013993524,7cyclictest1681006-21cyclictest00:35:291
1681013993524,7cyclictest0-21swapper/120:40:301
1681013993523,8cyclictest0-21swapper/119:40:291
1681013993520,8cyclictest0-21swapper/119:25:201
1681009993527,5cyclictest1691936-21phc2sys-jitter20:10:290
1681013993422,7cyclictest0-21swapper/119:15:301
1681013993421,5cyclictest0-21swapper/120:45:301
1681009993429,2cyclictest0-21swapper/023:30:290
1681009993428,4cyclictest0-21swapper/020:20:520
1681013993325,5cyclictest0-21swapper/100:25:191
1681013993323,7cyclictest0-21swapper/123:40:261
1681013993323,6cyclictest1736638-21grep00:30:281
1681013993323,5cyclictest0-21swapper/100:10:271
1681013993321,8cyclictest0-21swapper/100:15:301
168101399331,25cyclictest0-21swapper/122:20:251
1681013993225,4cyclictest1720525-21latency_hist22:59:591
1681013993224,4cyclictest0-21swapper/122:35:301
1681013993223,6cyclictest1717940-21grep22:40:281
1681013993222,7cyclictest0-21swapper/121:45:231
1681013993220,10cyclictest231ktimers/122:30:161
168101399321,25cyclictest0-21swapper/121:50:031
1681009993228,2cyclictest0-21swapper/021:59:060
1681013993123,6cyclictest1724122-21/usr/sbin/munin23:20:221
1681013993123,4cyclictest0-21swapper/120:55:161
1681013993122,6cyclictest0-21swapper/123:15:301
1681013993121,7cyclictest0-21swapper/120:15:001
1681013993114,9cyclictest0-21swapper/122:45:271
168101399311,28cyclictest0-21swapper/121:55:221
168101399311,24cyclictest0-21swapper/119:55:031
1681013992910,4cyclictest8321systemd-network21:07:261
1681013992819,5cyclictest0-21swapper/119:50:271
1681013992718,5cyclictest0-21swapper/123:50:291
1681013992717,7cyclictest231ktimers/123:00:101
1681013992717,7cyclictest231ktimers/123:00:101
1681013992712,3cyclictest14-21rcu_preempt20:30:021
1681013992712,3cyclictest14-21rcu_preempt20:30:021
168101399203,11cyclictest1681095-21cat19:10:011
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional