You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-06 - 21:27

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot6s.osadl.org (updated Sun Sep 06, 2026 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
31720210987,16sleep20-21swapper/207:05:582
31316210778,21sleep30-21swapper/307:05:153
30642210679,6sleep00-21swapper/007:05:080
31673210588,12sleep10-21swapper/107:05:331
310462760,0sleep30-21swapper/309:24:223
107212700,1sleep00-21swapper/008:55:130
32459993027,2cyclictest1812-21kworker/u8:010:02:043
32456993027,2cyclictest23234-21kworker/u8:109:58:040
32459992926,2cyclictest31921-21kworker/u8:011:37:043
32457992926,2cyclictest5363-21kworker/u8:112:24:041
32459992825,2cyclictest6097-21kworker/u8:109:36:043
32459992724,2cyclictest15770-21kworker/u8:211:56:043
32456992724,2cyclictest1812-21kworker/u8:010:08:040
32456992724,2cyclictest14654-21kworker/u8:211:18:010
32456992724,2cyclictest12209-21kworker/u8:210:28:050
32456992724,2cyclictest11067-21kworker/u8:010:49:040
32459992623,2cyclictest31921-21kworker/u8:011:49:043
32459992623,2cyclictest29152-21kworker/u8:110:40:043
32459992623,2cyclictest1978-21kworker/u8:009:40:043
32459992623,2cyclictest12209-21kworker/u8:210:28:013
32456992623,2cyclictest11067-21kworker/u8:010:58:040
61262250,0sleep10-21swapper/109:31:011
32459992522,2cyclictest5363-21kworker/u8:112:37:043
32459992522,2cyclictest14794-21kworker/u8:209:12:053
32459992522,2cyclictest12209-21kworker/u8:210:17:043
32459992522,2cyclictest12209-21kworker/u8:210:17:043
32459992522,2cyclictest11067-21kworker/u8:010:50:043
32459992421,2cyclictest7217-21kworker/u8:011:12:013
32459992421,2cyclictest6097-21kworker/u8:109:34:053
32459992421,2cyclictest28319-21kworker/u8:209:54:043
32459992421,2cyclictest1978-21kworker/u8:009:29:043
32459992419,3cyclictest24454-21kworker/u8:111:02:043
32456992421,2cyclictest31700-21kworker/u8:209:26:040
32456992421,2cyclictest23234-21kworker/u8:110:00:050
267602240,0sleep10-21swapper/112:35:041
32459992320,2cyclictest493-21kworker/u8:211:09:043
32459992320,2cyclictest22275-21kworker/u8:012:06:013
32459992320,2cyclictest20484-21kworker/u8:111:42:043
32459992320,2cyclictest12209-21kworker/u8:210:13:043
32459992320,2cyclictest12209-21kworker/u8:210:13:043
32456992320,2cyclictest31921-21kworker/u8:011:38:040
32456992320,2cyclictest20484-21kworker/u8:111:46:040
32456992320,2cyclictest14794-21kworker/u8:209:12:010
3245699230,18cyclictest0-21swapper/011:24:010
32459992219,2cyclictest29495-21kworker/u8:212:20:043
32459992219,2cyclictest29152-21kworker/u8:110:36:043
32459992219,2cyclictest22275-21kworker/u8:012:00:043
32459992219,2cyclictest20484-21kworker/u8:111:32:053
32459992219,2cyclictest19766-21kworker/u8:212:33:043
32459992219,2cyclictest14794-21kworker/u8:209:06:043
32459992219,2cyclictest14296-21kworker/u8:008:00:013
32459992219,2cyclictest14296-21kworker/u8:007:50:013
32459992219,2cyclictest12209-21kworker/u8:210:23:043
32459992219,2cyclictest11067-21kworker/u8:010:55:043
32459992219,2cyclictest11067-21kworker/u8:010:46:043
3245999220,18cyclictest0-21swapper/312:16:053
3245799221,2cyclictest2849-21rs:main1
32456992219,2cyclictest22275-21kworker/u8:012:07:040
32456992219,2cyclictest14654-21kworker/u8:211:27:040
32456992219,2cyclictest11067-21kworker/u8:010:44:050
3245699220,17cyclictest0-21swapper/009:35:040
3245699220,16cyclictest0-21swapper/009:30:010
32459992118,2cyclictest8431-21kworker/u8:208:55:043
32459992118,2cyclictest8431-21kworker/u8:208:52:013
32459992118,2cyclictest5363-21kworker/u8:112:26:043
32459992118,2cyclictest31921-21kworker/u8:011:50:043
32459992118,2cyclictest23234-21kworker/u8:109:56:043
32459992118,2cyclictest22841-21kworker/u8:108:14:043
32459992118,2cyclictest1812-21kworker/u8:010:05:043
32459992118,2cyclictest15212-21kworker/u8:107:26:043
32459992118,2cyclictest14296-21kworker/u8:008:08:013
32459992118,2cyclictest11203-21kworker/u8:007:11:043
32456992118,2cyclictest5363-21kworker/u8:112:39:040
32456992118,2cyclictest12209-21kworker/u8:210:32:040
32456992118,2cyclictest12209-21kworker/u8:210:11:040
32456992118,2cyclictest12209-21kworker/u8:210:11:040
3245699210,19cyclictest0-21swapper/007:45:120
32459992017,2cyclictest15212-21kworker/u8:107:33:043
32459992017,2cyclictest11203-21kworker/u8:007:16:043
3245999200,2cyclictest0-21swapper/312:11:043
3245999200,2cyclictest0-21swapper/311:23:043
3245999200,2cyclictest0-21swapper/309:15:043
3245899201,2cyclictest0-21swapper/211:40:132
3245899200,18cyclictest0-21swapper/209:40:112
3245899200,18cyclictest0-21swapper/207:45:112
32456992017,2cyclictest19766-21kworker/u8:212:32:040
116552200,1sleep0101ktimersoftd/011:14:540
32459991916,2cyclictest8572-21kworker/u8:207:38:043
32459991916,2cyclictest28960-21kworker/u8:208:28:013
32459991916,2cyclictest22841-21kworker/u8:108:20:043
3245999190,2cyclictest0-21swapper/310:34:013
3245999190,2cyclictest0-21swapper/309:47:043
32456991916,2cyclictest20484-21kworker/u8:111:31:040
32456991916,2cyclictest14794-21kworker/u8:209:16:040
32456991916,2cyclictest14588-21kworker/u8:012:22:040
32456991916,2cyclictest14296-21kworker/u8:007:56:060
3245699190,2cyclictest343-21ssh11:03:040
3245699190,2cyclictest0-21swapper/012:28:040
3245699190,2cyclictest0-21swapper/009:22:050
3245699190,12cyclictest0-21swapper/009:53:040
32459991815,2cyclictest6344-21kworker/u8:108:45:043
32459991815,2cyclictest14654-21kworker/u8:211:19:043
3245899180,16cyclictest0-21swapper/208:35:142
32456991815,2cyclictest15212-21kworker/u8:107:32:050
32456991815,2cyclictest15212-21kworker/u8:107:29:040
32456991815,2cyclictest11203-21kworker/u8:007:17:040
3245699180,5cyclictest0-21swapper/011:51:040
3245699180,2cyclictest0-21swapper/012:17:040
3245699180,2cyclictest0-21swapper/011:58:040
3245699180,2cyclictest0-21swapper/011:40:040
3245699180,2cyclictest0-21swapper/010:38:010
3245699180,2cyclictest0-21swapper/009:45:040
32459991714,2cyclictest28960-21kworker/u8:208:36:013
32459991714,2cyclictest15212-21kworker/u8:107:44:043
32459991714,2cyclictest14296-21kworker/u8:007:59:043
32459991714,2cyclictest14296-21kworker/u8:007:47:043
32459991714,2cyclictest11203-21kworker/u8:007:24:013
3245999170,2cyclictest0-21swapper/309:04:013
3245799172,12cyclictest0-21swapper/107:56:581
32456991714,2cyclictest28960-21kworker/u8:208:42:010
32456991714,2cyclictest28960-21kworker/u8:208:26:040
32456991714,2cyclictest22841-21kworker/u8:108:16:040
32456991714,2cyclictest14296-21kworker/u8:007:52:040
3245699170,2cyclictest0-21swapper/012:11:040
3245699170,2cyclictest0-21swapper/010:54:040
3245699170,2cyclictest0-21swapper/010:24:040
3245699170,15cyclictest0-21swapper/007:37:040
32459991613,2cyclictest1978-21kworker/u8:008:32:043
32457991611,3cyclictest29414-21fschecks_time08:20:131
3245799160,14cyclictest0-21swapper/112:00:161
3245699160,2cyclictest0-21swapper/012:02:040
3245999150,2cyclictest0-21swapper/311:28:043
3245799152,10cyclictest0-21swapper/107:39:581
32457991510,3cyclictest0-21swapper/110:55:131
3245799150,13cyclictest0-21swapper/111:30:061
3245799150,13cyclictest0-21swapper/110:24:071
3245799150,13cyclictest0-21swapper/109:28:311
3245799150,12cyclictest0-21swapper/110:50:021
3245799150,12cyclictest0-21swapper/108:11:581
3245799150,12cyclictest0-21swapper/107:33:591
32456991512,2cyclictest14296-21kworker/u8:007:42:040
32456991512,2cyclictest11203-21kworker/u8:007:22:040
32456991510,3cyclictest0-21swapper/009:05:130
3245699150,9cyclictest0-21swapper/011:05:040
3245699150,2cyclictest0-21swapper/010:15:040
3245699150,2cyclictest0-21swapper/010:15:040
3245699150,2cyclictest0-21swapper/009:04:010
3245699150,2cyclictest0-21swapper/008:05:040
32458991410,2cyclictest0-21swapper/207:40:132
3245799141,6cyclictest0-21swapper/108:58:581
3245799140,2cyclictest0-21swapper/112:18:161
3245799140,12cyclictest0-21swapper/112:10:151
3245799140,12cyclictest0-21swapper/109:57:131
3245799140,12cyclictest0-21swapper/109:20:351
3245799140,12cyclictest0-21swapper/107:10:281
3245699140,2cyclictest0-21swapper/009:43:040
3245699140,2cyclictest0-21swapper/008:00:050
3932130,3sleep10-21swapper/110:30:181
3245999131,10cyclictest0-21swapper/308:15:373
3245999130,2cyclictest0-21swapper/308:40:123
3245899138,3cyclictest30452-21ntp_states11:00:192
3245899138,3cyclictest25295-21cat09:50:172
3245899130,11cyclictest19165-21http10:50:002
3245799139,2cyclictest0-21swapper/111:05:551
3245799138,3cyclictest17057-21tr07:50:121
3245799136,6cyclictest0-21swapper/110:37:591
3245799132,10cyclictest0-21swapper/107:23:591
32457991310,2cyclictest16551-21diskmemload10:00:131
32457991310,2cyclictest0-21swapper/112:07:261
32457991310,2cyclictest0-21swapper/111:50:261
32457991310,2cyclictest0-21swapper/111:46:311
32457991310,2cyclictest0-21swapper/111:27:351
32457991310,2cyclictest0-21swapper/111:14:331
32457991310,2cyclictest0-21swapper/110:44:151
32457991310,2cyclictest0-21swapper/110:10:021
32457991310,2cyclictest0-21swapper/110:10:021
32457991310,2cyclictest0-21swapper/109:50:551
32457991310,2cyclictest0-21swapper/109:10:281
3245799130,2cyclictest0-21swapper/111:35:141
3245799130,2cyclictest0-21swapper/111:01:151
3245799130,2cyclictest0-21swapper/110:45:451
3245799130,2cyclictest0-21swapper/110:15:051
3245799130,2cyclictest0-21swapper/110:15:051
3245799130,2cyclictest0-21swapper/110:06:211
3245799130,2cyclictest0-21swapper/109:49:251
3245799130,2cyclictest0-21swapper/109:17:431
3245799130,12cyclictest0-21swapper/112:34:261
3245799130,12cyclictest0-21swapper/112:27:161
3245799130,12cyclictest0-21swapper/111:20:401
3245799130,12cyclictest0-21swapper/111:18:091
3245799130,12cyclictest0-21swapper/110:25:291
3245799130,12cyclictest0-21swapper/109:40:071
3245799130,12cyclictest0-21swapper/109:36:251
3245799130,12cyclictest0-21swapper/108:45:121
3245799130,11cyclictest16551-21diskmemload11:55:541
3245799130,10cyclictest0-21swapper/107:16:581
3245699138,3cyclictest0-21swapper/008:46:040
7012120,1sleep20-21swapper/209:25:422
3245899129,2cyclictest0-21swapper/212:39:552
3245899127,3cyclictest0-21swapper/210:40:192
3245899123,6cyclictest1111-21ssh10:31:012
3245899122,6cyclictest0-21swapper/212:00:002
3245899122,5cyclictest0-21swapper/210:40:012
3245899121,9cyclictest7642-21perl12:15:142
3245899121,6cyclictest0-21swapper/208:55:002
3245899120,10cyclictest474-21taskset11:35:182
3245799129,2cyclictest0-21swapper/109:00:151
3245799129,2cyclictest0-21swapper/108:50:391
3245799129,2cyclictest0-21swapper/108:35:181
3245799129,2cyclictest0-21swapper/108:00:401
3245799123,2cyclictest4960-21cpuspeed_turbos11:40:141
3245799122,9cyclictest0-21swapper/107:49:011
3245799122,7cyclictest0-21swapper/108:32:591
3245799120,11cyclictest0-21swapper/108:25:181
3245799120,11cyclictest0-21swapper/108:05:051
3245699129,2cyclictest28960-21kworker/u8:208:24:050
3245699120,2cyclictest0-21swapper/008:37:040
3245699120,2cyclictest0-21swapper/008:33:040
3245699120,2cyclictest0-21swapper/007:12:040
309542120,2sleep20-21swapper/210:29:072
220092120,2sleep222083-21munin-node2
3245899118,2cyclictest10544-21apt-get07:35:112
3245899117,2cyclictest0-21swapper/209:05:192
3245899116,3cyclictest3249-21rm11:05:332
3245899116,3cyclictest15255-21ssh10:12:532
3245899116,3cyclictest15255-21ssh10:12:532
3245899113,5cyclictest0-21swapper/207:21:012
3245899112,5cyclictest301ktimersoftd/209:05:002
3245899111,7cyclictest10585-21sendmail-mta11:15:102
3245899111,6cyclictest0-21swapper/209:24:152
3245899111,5cyclictest0-21swapper/210:00:002
3245899110,3cyclictest10856-21rm11:45:352
3245899110,2cyclictest8494-21apt-get07:30:092
3245899110,2cyclictest0-21swapper/210:00:042
3245799118,2cyclictest0-21swapper/108:15:081
3245799113,6cyclictest0-21swapper/109:09:121
3245799110,10cyclictest0-21swapper/107:40:591
281382110,1sleep20-21swapper/212:03:352
268742110,7sleep20-21swapper/211:30:042
226082110,2sleep20-21swapper/208:04:522
189992110,2sleep219013-21ssh09:11:152
3245899107,2cyclictest0-21swapper/210:55:182
3245899107,2cyclictest0-21swapper/210:15:342
3245899107,2cyclictest0-21swapper/210:15:342
3245899107,2cyclictest0-21swapper/208:55:152
3245899107,2cyclictest0-21swapper/207:11:022
3245899106,2cyclictest16551-21diskmemload12:33:412
3245899105,3cyclictest4941-21grep08:40:132
3245899105,3cyclictest4626-21telnet09:30:132
3245899105,3cyclictest28651-21cron08:20:002
3245899105,3cyclictest2021-21tail12:10:122
3245899105,3cyclictest19173-21cat11:55:002
3245899100,9cyclictest0-21swapper/210:53:362
3245899100,9cyclictest0-21swapper/209:15:352
3245899100,8cyclictest0-21swapper/211:10:302
3245899100,2cyclictest0-21swapper/209:35:252
3245799100,2cyclictest0-21swapper/108:40:171
3245699105,3cyclictest25160-21df08:10:130
319272100,2sleep20-21swapper/208:25:322
259312100,1sleep20-21swapper/208:11:012
223222100,2sleep222334-21ssh09:47:232
324589994,3cyclictest6071-21sendmail-mta07:26:022
324589994,3cyclictest5581-21sendmail-mta10:05:452
324589994,3cyclictest23543-21sendmail_mailqu10:21:002
324589994,3cyclictest17035-21sendmail-mta11:20:092
324589994,3cyclictest13748-21timerandwakeup12:21:022
324589993,4cyclictest755-21tr08:30:132
324589991,3cyclictest27949-21sendmail-mta12:05:432
324589990,6cyclictest0-21swapper/208:45:102
324569994,3cyclictest9248-21gltestperf08:50:140
19855290,1sleep20-21swapper/207:55:592
324589983,3cyclictest29235-21df_abs08:20:122
324589983,3cyclictest22487-21sendmail-mta08:05:042
324589983,3cyclictest17190-21fschecks_count07:50:132
324589983,3cyclictest17119-21aten2.4-expect12:25:122
324589980,7cyclictest0-21swapper/207:15:042
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional