You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-23 - 05:55

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot4s (updated Wed Sep 23, 2026 00:59:01)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
197999912131186,23cyclictest20383-21fschecks_time19:25:151
197989911541105,36cyclictest20539-21iostat_ios19:25:200
193362652605,31sleep10-21swapper/119:20:431
193892601547,39sleep00-21swapper/019:21:140
113892780,3sleep041ktimersoftd/021:50:250
1979899748,37cyclictest15043-21grep23:25:290
222192710,5sleep0111rcuc/022:20:220
1979899681,48cyclictest24405-21aten_r4power_po19:35:120
1979999678,32cyclictest11921-21taskset21:52:281
1979899658,39cyclictest6750-21fschecks_time23:05:170
1979899651,42cyclictest10302-21taskset20:21:280
1979899651,40cyclictest16348-21expr22:05:130
19799996415,14cyclictest5719-21if_eth020:10:181
1979899642,40cyclictest29920-21python00:05:270
1979899641,43cyclictest27412-21fschecks_count00:00:160
1979899641,42cyclictest17760-21grep23:35:120
1979899641,37cyclictest19748-21taskset23:40:110
1979899641,37cyclictest19748-21taskset23:40:110
1979899631,40cyclictest30917-21taskset21:15:410
1979899631,40cyclictest11565-21gdbus23:02:340
1979999629,19cyclictest10099-21taskset21:48:051
1979899625,38cyclictest5816-21munin-run00:30:000
1979899622,41cyclictest32478-21mailstats21:20:280
1979899622,41cyclictest2122-21ntpdc20:00:240
1979899622,41cyclictest2122-21ntpdc20:00:240
1979899622,40cyclictest28928-21ntpq19:45:230
1979899621,44cyclictest4262-21taskset22:59:550
1979899621,43cyclictest31853-21taskset19:55:110
1979899621,43cyclictest13763-21cat23:25:010
1979899621,42cyclictest17398-21chrt23:34:350
1979899621,41cyclictest27179-21taskset22:34:390
1979899621,41cyclictest1908-21taskset22:51:030
1979899621,40cyclictest16898-21fschecks_time20:40:150
1979899621,40cyclictest15988-21sh20:37:010
1979999619,18cyclictest9860-21cut20:20:271
1979999618,20cyclictest8394-21taskset21:44:521
19799996115,15cyclictest30855-21aten_r4power_po00:10:131
19799996110,17cyclictest4677-21cat21:35:011
1979899612,38cyclictest26717-21hddtemp_smartct19:40:180
1979899611,42cyclictest14880-21taskset00:51:110
1979899611,41cyclictest9127-21runrttasks00:35:330
1979899611,41cyclictest28884-21taskset22:37:520
1979899611,41cyclictest24641-21python22:25:270
1979899611,41cyclictest23886-21taskset19:32:020
1979899611,41cyclictest11433-21taskset23:16:170
19798996113,35cyclictest27127-21users21:05:320
19798996112,35cyclictest12972-21df20:30:140
19798996110,34cyclictest23489-21cstates23:50:130
1979999609,16cyclictest19509-21grep20:45:311
1979999609,16cyclictest17328-21taskset23:33:511
1979899601,41cyclictest30334-21fschecks_count19:50:160
1979899601,41cyclictest18413-21grep22:10:210
1979899601,40cyclictest7179-21grep21:40:150
1979899601,40cyclictest6665-21taskset20:12:530
1979899601,40cyclictest4504-21taskset21:33:380
1979899601,40cyclictest21539-21runrttasks22:19:430
1979899601,37cyclictest11038-21snmpd20:06:340
19798996011,32cyclictest25965-21ntp_states23:55:240
19799995911,16cyclictest26162-21cat19:40:001
1979899592,44cyclictest29960-21memory22:40:200
1979899591,42cyclictest23369-21runrttasks20:55:290
1979899591,40cyclictest2401-21NetworkManager21:59:400
19798995912,30cyclictest8894-21/usr/sbin/munin23:10:260
1979999589,17cyclictest12137-21grep23:20:121
1979999589,16cyclictest4418-21wc23:00:011
1979999588,16cyclictest27849-21awk00:00:241
1979999587,18cyclictest2868-21chrt20:02:321
1979999587,18cyclictest2868-21chrt20:02:321
1979999587,17cyclictest734-21chrt19:56:081
1979999585,23cyclictest2308-21chrt21:26:151
19799995810,18cyclictest11038-21snmpd21:20:141
1979899582,44cyclictest18634-21diskstats20:45:170
1979899581,39cyclictest24676-21memory21:00:220
1979899581,38cyclictest13172-21chrt00:47:560
19798995811,30cyclictest6751-21/usr/sbin/munin00:30:210
1979999578,16cyclictest9907-21wc00:40:131
1979999577,17cyclictest31519-21chrt19:53:131
19799995710,11cyclictest5846-21chrt23:01:401
1979899572,38cyclictest31674-21/usr/sbin/munin00:10:280
1979899572,34cyclictest6403-21chrt21:38:510
1979899571,40cyclictest9865-21runrttasks21:45:400
1979899571,40cyclictest11564-21packagekitd22:45:530
19799995616,11cyclictest22691-21iostat_ios20:55:201
1979899562,49cyclictest0-21swapper/021:25:250
1979899562,41cyclictest14822-21iostat_ios22:00:220
1979899562,41cyclictest11639-21ntp_states20:25:230
1979999559,17cyclictest26196-21fschecks_count21:05:171
19799995514,21cyclictest23990-21/usr/sbin/munin21:00:121
19799995512,10cyclictest8071-21cstates00:35:121
19799995510,11cyclictest27977-21iostat_ios22:35:201
1979899552,40cyclictest9897-21/usr/sbin/munin00:40:120
1979899552,40cyclictest2729-21iostat_ios00:20:190
1979899552,40cyclictest22064-21/usr/sbin/munin23:45:220
1979999549,16cyclictest30280-21mailstats22:40:251
1979999549,14cyclictest29468-21if_eth000:05:181
19799995410,11cyclictest28396-21diskstats19:45:141
1979999539,18cyclictest14431-21tr22:00:141
1979999538,10cyclictest17048-21iostat20:40:181
19799995313,15cyclictest18207-21irqstats23:35:211
1979899531,39cyclictest28913-21/usr/sbin/munin21:10:340
19799995215,13cyclictest11401-21iostat20:25:191
19799995214,17cyclictest3286-21runrttasks21:10:271
19799995113,16cyclictest25821-21memory23:55:221
19799995112,11cyclictest20540-21memory22:15:211
1979999509,12cyclictest22941-21grep19:30:161
1979999509,10cyclictest15133-21awk20:35:171
19799995019,16cyclictest2729-21iostat_ios00:20:201
19799995015,11cyclictest29623-21/usr/sbin/munin21:15:331
19799995014,11cyclictest9037-21ntp_states23:10:291
19799995013,16cyclictest6817-21perl23:05:181
19799995013,12cyclictest490-21df_inode00:15:151
19799995011,18cyclictest5771-21taskset00:29:421
1979899501,45cyclictest7320-21df20:15:130
1979899501,45cyclictest1602-21taskset00:16:450
1979999499,19cyclictest21580-21seq20:51:231
1979999497,19cyclictest13951-21taskset21:59:061
19799994918,14cyclictest6124-21cron21:36:001
19799994913,21cyclictest25792-21df_inode22:30:151
19799994913,15cyclictest12986-21diskstats20:30:151
19799994912,25cyclictest17980-21/usr/sbin/munin22:10:161
19799994912,10cyclictest11565-21gdbus22:05:191
19799994911,25cyclictest7242-21taskset00:30:301
19799994911,21cyclictest15349-21taskset23:27:451
1979999489,17cyclictest12654-21tr00:45:271
1979999488,17cyclictest15369-21cut00:55:011
1979999486,22cyclictest24670-21taskset23:51:521
19799994812,22cyclictest1837-21users22:50:301
19798994812,32cyclictest218692chrt20:54:240
1979999478,19cyclictest24101-21fschecks_time22:25:171
1979999477,16cyclictest20987-21chrt23:42:361
1979999477,16cyclictest20987-21chrt23:42:361
19799994719,15cyclictest3875-21iostat20:05:191
19799994714,14cyclictest7718-21memory20:15:221
1979999467,17cyclictest22919-21chrt23:48:091
1979999467,16cyclictest10937-21/usr/sbin/munin23:15:251
1979999465,17cyclictest32567-21chrt22:46:561
19799994612,14cyclictest11038-21snmpd19:41:061
1979999458,16cyclictest22567-21awk22:20:291
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional