You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-18 - 10:28

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Sat Jul 18, 2026 00:44:14)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
110596323080,4sleep3481ktimers/322:37:283
898791996454,7cyclictest1010065-21latency_hist21:00:011
9884252610,3sleep2371rcuc/220:37:312
898791995948,9cyclictest984855-21apt-get20:35:001
898791995649,5cyclictest1055163-21kworker/u8:0+flush-8:022:47:401
898791995546,6cyclictest281-21systemd-journal00:10:001
898791995542,10cyclictest281-21systemd-journal22:27:401
898791995445,7cyclictest1019976-21kworker/u8:2+flush-8:021:47:401
898791995344,7cyclictest1219235-21/usr/sbin/munin00:32:381
898786995344,6cyclictest1085021-21latency_hist22:15:010
9691942520,2sleep2371rcuc/220:17:332
898791995246,4cyclictest1125037-21kworker/u8:2+flush-8:023:47:401
898791995145,4cyclictest960099-21kworker/u8:1+flush-8:021:22:401
898786995041,7cyclictest974949-21latency_hist20:25:010
10708022490,5sleep3451irq_work/322:02:263
898791994843,3cyclictest852113-21kworker/u8:1+flush-8:019:42:261
898791994839,6cyclictest1039743-21latency_hist21:30:011
898791994838,7cyclictest920468-21latency_hist19:30:001
898786994735,9cyclictest1153697-21ntpq23:22:340
898791994640,4cyclictest1000169-21latency_hist20:50:001
898791994635,8cyclictest1029882-21latency_hist21:20:011
89878699467,37cyclictest608-21sshd19:52:390
898786994635,9cyclictest1000571-21/usr/sbin/munin20:52:400
10814402460,2chrt584-21kworker/3:2-events22:12:293
898796994538,5cyclictest1099844-21apt-get22:30:002
898791994541,3cyclictest1055163-21kworker/u8:0+flush-8:023:32:281
898791994536,7cyclictest281-21systemd-journal20:55:001
898791994536,7cyclictest1144774-21kworker/u8:1+flush-8:023:27:371
898786994538,5cyclictest1020386-21apt-get21:12:230
898786994515,13cyclictest585-21runrttasks00:22:240
898786994515,13cyclictest585-21runrttasks00:22:240
898786994435,6cyclictest1189134-21latency_hist00:00:010
898791994339,3cyclictest1055163-21kworker/u8:0+flush-8:023:22:381
898791994338,4cyclictest1144774-21kworker/u8:1+flush-8:023:17:281
898791994333,7cyclictest281-21systemd-journal22:37:401
898791994237,3cyclictest1054854-21latency_hist21:45:011
898791994235,4cyclictest1055163-21kworker/u8:0+events_unbound22:07:401
898791994234,6cyclictest281-21systemd-journal22:30:011
898791994233,7cyclictest1040148-21/usr/sbin/munin21:32:351
898786994234,6cyclictest1139636-21latency_hist23:10:000
898786994211,18cyclictest585-21runrttasks23:42:360
898791994136,3cyclictest960099-21kworker/u8:1+flush-8:021:12:401
898791994033,5cyclictest975384-21apt-get20:27:221
898791994033,5cyclictest852113-21kworker/u8:1+flush-8:019:37:411
898791994033,5cyclictest852113-21kworker/u8:1+flush-8:019:37:411
898791994030,7cyclictest1114183-21ntpq22:42:341
898796993933,4cyclictest1055163-21kworker/u8:0+flush-8:023:37:442
898791993930,6cyclictest915528-21kworker/u8:0+flush-8:019:47:401
898791993929,8cyclictest914846-21ntpq19:22:421
898786993928,9cyclictest950891-21diskstats20:02:280
898791993833,4cyclictest960099-21kworker/u8:1+flush-8:021:07:401
898791993832,4cyclictest960099-21kworker/u8:1+flush-8:020:42:401
898791993828,7cyclictest960083-21latency_hist20:10:011
898786993827,8cyclictest1030573-21diskstats21:22:270
898791993728,7cyclictest1213166-21ntpq00:22:371
898791993728,7cyclictest1213166-21ntpq00:22:371
898786993727,8cyclictest1203272-21ntpq00:12:370
898786993726,9cyclictest939587-21ntpq19:47:350
8941542378,22sleep10-21swapper/119:07:231
898791993632,3cyclictest852113-21kworker/u8:1+flush-8:019:17:381
898791993629,5cyclictest1055163-21kworker/u8:0+events_unbound23:57:261
898791993628,6cyclictest1065074-21cp21:55:001
898786993627,6cyclictest281-21systemd-journal21:07:400
898786993611,13cyclictest585-21runrttasks21:57:240
898786993611,13cyclictest585-21runrttasks21:57:240
898791993528,5cyclictest899111-21apt-get19:12:211
898786993511,12cyclictest585-21runrttasks22:42:220
898791993429,4cyclictest1169356-21kworker/u8:3+flush-8:023:42:411
898791993428,4cyclictest1218597-21grep00:27:421
898791993428,4cyclictest1124811-21latency_hist22:55:011
898791993427,5cyclictest970426-21apt-get20:22:231
898791993426,6cyclictest960099-21kworker/u8:1+flush-8:022:02:291
898791993426,5cyclictest965067-21latency_hist20:15:011
898791993425,7cyclictest1133944-21ntpq23:02:361
898786993411,11cyclictest585-21runrttasks00:07:400
898791993327,5cyclictest1055163-21kworker/u8:0+flush-8:023:52:361
898791993326,5cyclictest935576-21kworker/u8:3+flush-8:020:02:321
898791993324,6cyclictest281-21systemd-journal20:18:411
89878699339,11cyclictest979369-21python320:27:410
89878699339,10cyclictest1050649-21uniq21:42:260
89878699338,14cyclictest1029157-21ntpq21:17:380
89878699337,15cyclictest1218100-21ntpq00:27:350
89878699337,14cyclictest585-21runrttasks21:27:230
89878699335,18cyclictest924735-21ntpq19:32:380
89878699334,15cyclictest1093952-21wc22:22:320
898786993323,7cyclictest1079298-21ntpq22:07:370
89855323325,3sleep00-21swapper/019:09:190
8941172334,9sleep20-21swapper/219:07:162
898791993227,3cyclictest942909-21kthreadcore19:52:321
89878699328,13cyclictest1189973-21/usr/sbin/munin00:02:270
89878699328,12cyclictest1043926-21ntpq21:32:370
89878699327,14cyclictest964326-21ntpq20:12:360
89878699327,10cyclictest1184169-21munin-run23:55:000
89878699326,16cyclictest1049259-21/usr/sbin/munin21:37:400
89878699326,15cyclictest984158-21ntpq20:32:380
89878699325,10cyclictest10747521timerandwakeup22:02:420
89878699324,18cyclictest1-21systemd23:40:010
89878699324,17cyclictest1163617-21ld23:32:370
89878699322,17cyclictest0-21swapper/020:45:030
898786993214,6cyclictest1132451-21kthreadcore23:02:330
898786993210,10cyclictest1014329-21ntpq21:02:410
89878699320,20cyclictest0-21swapper/000:17:330
898791993127,3cyclictest1055163-21kworker/u8:0+flush-8:021:55:151
898791993127,3cyclictest1055163-21kworker/u8:0+flush-8:021:55:151
898791993124,5cyclictest945684-21apt-get19:57:221
89878699318,13cyclictest1124309-21python322:52:400
89878699318,13cyclictest1105959-21/usr/sbin/munin22:37:280
89878699317,15cyclictest899832-21/usr/sbin/munin19:12:290
89878699316,15cyclictest956457-21irqstats20:07:290
89878699316,15cyclictest1119139-21ntpq22:47:370
89878699316,14cyclictest1158745-21ntpq23:27:380
89878699316,14cyclictest1104372-21ntp_states22:32:380
89878699315,16cyclictest985434-21sshd20:36:390
89878699315,15cyclictest904061-21users19:15:040
89878699315,15cyclictest1089261-21ntpq22:17:380
898786993124,5cyclictest1140034-21/usr/sbin/munin23:12:340
898786993124,5cyclictest1140034-21/usr/sbin/munin23:12:340
89878699312,19cyclictest0-21swapper/019:22:250
898786993114,10cyclictest585-21runrttasks19:28:190
898786993112,9cyclictest384-21dbus-daemon00:32:380
898786993111,10cyclictest969239-21ntpq20:17:340
898786993110,10cyclictest1064189-21ntpq21:52:350
898791993024,5cyclictest980233-21kworker/u8:2+events_unbound20:35:011
898791993023,5cyclictest1079575-21kworker/u8:2+flush-8:022:12:351
89878699308,11cyclictest1228213-21ntpq00:37:350
89878699307,13cyclictest990823-21hddtemp_smartct20:42:280
89878699307,13cyclictest949455-21ntpq19:57:360
89878699306,14cyclictest1148720-21ntpq23:17:350
89878699306,14cyclictest1129243-21sensors_volt22:57:410
89878699306,13cyclictest1009278-21ntpq20:57:360
89878699305,14cyclictest930895-21aten2_r5power_p19:42:230
89878699305,12cyclictest1055369-21aten2_r5power_v21:47:240
89878699304,16cyclictest1099872-21apt-config22:30:000
898786993010,10cyclictest1178469-21ntpq23:47:350
898796992925,3cyclictest970691-21fschecks_count20:22:272
898796992921,6cyclictest1080032-21cat22:10:002
898791992924,3cyclictest1228146-21needreboot00:37:331
898791992922,5cyclictest1090184-21kworker/u8:1+flush-8:022:22:351
89878699296,12cyclictest929889-21python319:37:410
89878699296,12cyclictest929889-21python319:37:410
898796992825,2cyclictest910521-21cron19:20:002
898796992825,2cyclictest1129736-21cron23:00:002
898796992824,2cyclictest1110009-21sendmail22:40:012
898796992824,2cyclictest1055338-21aten2_r5power_e21:47:242
898796992823,3cyclictest1045401-21aten2_r5power_e21:37:242
898791992824,3cyclictest1179249-21kworker/u8:1+events_unbound00:02:271
898796992723,3cyclictest1183585-21sendmail_mailqu23:52:382
898796992723,2cyclictest1175075-21fschecks_time23:47:272
898796992719,6cyclictest1064979-21apt-get21:55:002
898791992723,3cyclictest1189385-21kworker/u8:3+flush-8:000:10:311
898791992723,3cyclictest1069965-21kworker/u8:3-ext4-rsv-conversion22:20:001
898791992720,5cyclictest281-21systemd-journal23:37:391
898796992621,3cyclictest1020445-21aten2_r5power_e21:12:252
898796992620,4cyclictest0-21swapper/200:40:002
898796992618,6cyclictest1158804-21wc23:27:402
898796992522,2cyclictest1184653-21aten2_r5power_e23:57:252
898796992521,3cyclictest1019943-21cron21:10:012
898796992521,2cyclictest1164347-21cron23:35:002
898796992521,2cyclictest1034796-21cron21:25:002
898796992520,3cyclictest0-21swapper/200:20:002
898796992516,7cyclictest955152-21cat20:05:002
898791992520,3cyclictest1014089-21wc21:02:351
898796992420,2cyclictest914940-21grep19:22:442
898796992420,2cyclictest1154450-21cron23:25:002
898791992420,3cyclictest1125037-21kworker/u8:2+events_unbound23:15:001
898791992420,3cyclictest1125037-21kworker/u8:2+events_unbound23:15:001
898796992320,2cyclictest936085-21fschecks_time19:47:262
898796992313,8cyclictest1089943-21awk22:20:002
898791992318,4cyclictest960099-21kworker/u8:1+flush-8:021:37:331
898791992318,4cyclictest1129467-21unixbench_multi22:57:421
898796992219,2cyclictest1000911-21fschecks_time20:52:272
898796992218,3cyclictest1069887-21unixbench_singl21:57:442
898796992218,3cyclictest1069887-21unixbench_singl21:57:442
898796992218,2cyclictest0-21swapper/220:12:342
898796992215,5cyclictest984962-21store20:35:002
898791992217,4cyclictest852113-21kworker/u8:1+events_unbound19:32:311
898791992217,4cyclictest1055163-21kworker/u8:0+flush-8:023:07:351
898791992217,3cyclictest1208351-21sendmail_mailqu00:17:411
898796992117,2cyclictest1213887-21cron00:25:002
898796992117,2cyclictest1213887-21cron00:25:002
898796992116,4cyclictest1039736-21cron21:30:002
898796992017,2cyclictest995722-21aten2_r5power_e20:47:242
898796992017,2cyclictest921209-21fschecks_time19:32:252
89879699192,12cyclictest1219260-21apt-get00:32:222
898796991916,2cyclictest941039-21fschecks_count19:52:272
898796991916,2cyclictest916021-21aten2_r5power_p19:27:242
898796991916,2cyclictest1009787-21grep20:57:442
898796991915,3cyclictest926054-21cpuspeed_turbos19:37:252
898796991915,3cyclictest926054-21cpuspeed_turbos19:37:252
898796991915,3cyclictest0-21swapper/221:35:002
898796991915,2cyclictest1199676-21cpuspeed_turbos00:12:252
898796991913,4cyclictest1084186-21needreboot22:12:322
898796991913,4cyclictest0-21swapper/222:25:012
89879699190,7cyclictest1193349-21/usr/sbin/munin00:02:352
8940712193,9sleep30-21swapper/319:06:413
89879699187,9cyclictest1102820-21tr22:32:322
89879699181,4cyclictest1054852-21turbostat.cron21:45:002
898796991814,2cyclictest0-21swapper/221:02:412
898796991810,6cyclictest901287-21tr19:12:312
89879699172,11cyclictest1214328-21apt-get00:27:232
898796991712,3cyclictest979441-21threads20:27:412
89879699171,11cyclictest1070571-21apt-get22:02:242
89879699168,5cyclictest1124542-21grep22:52:422
89879699166,8cyclictest1147941-21tr23:17:332
89879699162,13cyclictest0-21swapper/219:56:072
89879699162,13cyclictest0-21swapper/219:41:262
898796991613,2cyclictest1144307-21unixbench_singl23:12:422
898796991613,2cyclictest1144307-21unixbench_singl23:12:422
898796991613,2cyclictest0-21swapper/223:07:462
898796991613,2cyclictest0-21swapper/222:49:112
898796991612,2cyclictest0-21swapper/223:42:312
898796991612,2cyclictest0-21swapper/223:02:382
898796991612,2cyclictest0-21swapper/222:42:252
898796991612,2cyclictest0-21swapper/220:07:262
898796991611,3cyclictest1025572-21tr21:17:252
898796991611,3cyclictest0-21swapper/220:45:002
10453402162,9sleep30-21swapper/321:37:233
10854472152,9sleep30-21swapper/322:17:233
89879699146,6cyclictest1194560-21cut00:07:252
9904212133,7sleep30-21swapper/320:42:223
9749782132,6sleep30-21swapper/320:25:013
9295682132,6sleep30-21swapper/319:37:353
9295682132,6sleep30-21swapper/319:37:353
9204522132,6sleep30-21swapper/319:30:003
12237782130,8sleep30-21swapper/300:35:023
11981432132,7sleep30-21swapper/300:07:383
11445692132,6sleep30-21swapper/323:15:013
11198982132,6sleep30-21swapper/322:50:013
10397292132,6sleep30-21swapper/321:30:013
10001832132,6sleep30-21swapper/320:50:013
9895712123,6sleep30-21swapper/320:37:413
9713692122,6sleep30-21swapper/320:22:333
9510752122,6sleep30-21swapper/320:02:303
9486332122,6sleep30-21swapper/319:57:333
9445862122,6sleep30-21swapper/319:52:393
9353662122,6sleep30-21swapper/319:45:013
9352222122,6sleep30-21swapper/319:43:413
9029852122,6sleep30-21swapper/319:12:393
12180492122,6sleep30-21swapper/300:27:353
12089072122,6sleep30-21swapper/300:20:013
12089072122,6sleep30-21swapper/300:20:013
12058742122,6sleep30-21swapper/300:17:323
11940732122,6sleep30-21swapper/300:05:003
11841622122,6sleep30-21swapper/323:55:013
11841002122,6sleep30-21swapper/323:54:253
11749712122,6sleep30-21swapper/323:47:273
11587852122,6sleep30-21swapper/323:27:413
11437912122,6sleep30-21swapper/323:12:363
11437912122,6sleep30-21swapper/323:12:363
11393482122,6sleep30-21swapper/323:07:433
11263322123,5sleep30-21swapper/322:57:313
11126222123,5sleep30-21swapper/322:42:313
11003002123,6sleep30-21swapper/322:30:033
10904642122,6sleep30-21swapper/322:22:253
10765072122,6sleep30-21swapper/322:07:323
10660102122,6sleep30-21swapper/321:57:303
10660102122,6sleep30-21swapper/321:57:293
10641962123,5sleep30-21swapper/321:52:363
10594912122,6sleep30-21swapper/321:47:423
10507382122,6sleep30-21swapper/321:42:293
10310002122,6sleep30-21swapper/321:22:313
10253532122,6sleep30-21swapper/321:17:253
9965492112,5sleep30-21swapper/320:47:323
9801262112,5sleep30-21swapper/320:30:313
9653672112,6sleep30-21swapper/320:16:063
9604762112,6sleep30-21swapper/320:12:173
9559982112,5sleep30-21swapper/320:07:283
9208172112,6sleep30-21swapper/319:31:413
9113492112,5sleep30-21swapper/319:22:303
9059332112,6sleep30-21swapper/319:17:093
12242672112,6sleep30-21swapper/300:35:173
12034882112,5sleep30-21swapper/300:12:423
11695732112,6sleep30-21swapper/323:40:123
11651332112,5sleep30-21swapper/323:37:283
11602422112,5sleep30-21swapper/323:32:303
11498012112,6sleep30-21swapper/323:20:433
11300572113,5sleep30-21swapper/323:00:573
11192892112,5sleep30-21swapper/322:47:413
10995872112,5sleep30-21swapper/322:27:423
10352402112,5sleep30-21swapper/321:27:243
10202482112,6sleep30-21swapper/321:10:553
10149802112,5sleep30-21swapper/321:05:013
10143302112,5sleep30-21swapper/321:02:413
10054302112,6sleep30-21swapper/320:56:233
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional