You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-16 - 05:58

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Congatec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot8s.osadl.org (updated Tue Dec 16, 2025 00:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3284749912450,1241cyclictest7500092sleep300:34:563
3284749912311,1225cyclictest4722492sleep320:59:573
3284749911260,1123cyclictest7177312sleep300:09:563
3284749910620,1058cyclictest5949882sleep322:34:573
301798200,6rtkit-daemon636-21snmpd21:30:562
328474991815,1cyclictest0-21swapper/323:45:003
32847499178,6cyclictest433751-21turbostat20:30:013
32847499171,12cyclictest633180-21taskset23:00:203
3576472160,5sleep1358708-21cut19:30:161
32847499169,4cyclictest382095-21turbostat19:50:013
32847499155,7cyclictest356428-21turbostat19:29:593
328474991513,1cyclictest0-21swapper/323:13:533
328474991513,1cyclictest0-21swapper/321:22:523
328474991512,1cyclictest0-21swapper/323:48:573
328474991512,1cyclictest0-21swapper/320:37:203
32847499151,11cyclictest672980-21taskset23:35:143
32847499151,11cyclictest569579-21taskset22:15:013
32847499151,10cyclictest582234-21turbostat22:25:003
32847499151,10cyclictest530580-21taskset21:45:123
32847499141,9cyclictest6599612sleep323:25:143
32847499141,9cyclictest605107-21taskset22:40:173
328474991412,1cyclictest0-21swapper/323:30:303
328474991412,1cyclictest0-21swapper/322:36:083
328474991412,1cyclictest0-21swapper/300:12:573
328474991412,1cyclictest0-21swapper/300:00:393
328474991412,0cyclictest0-21swapper/322:03:093
328474991412,0cyclictest0-21swapper/321:31:223
328474991411,1cyclictest0-21swapper/323:55:153
328474991411,1cyclictest0-21swapper/321:35:223
328474991411,1cyclictest0-21swapper/320:32:243
328474991411,1cyclictest0-21swapper/300:23:283
32847499141,10cyclictest743367-21turbostat00:29:593
32847499141,10cyclictest724396-21taskset00:15:133
32847499141,10cyclictest569016-21taskset22:14:123
32847499141,10cyclictest478682-21turbostat21:05:003
32847499141,10cyclictest407840-21turbostat20:10:003
32847499141,10cyclictest400771-21taskset20:00:233
32847499141,10cyclictest362506-21taskset19:30:573
32847499141,10cyclictest337749-21chrt19:15:153
32847499140,9cyclictest6938022sleep323:50:183
7048782131,4sleep0704939-40mandb00:00:010
4594272131,9sleep0459654-21cat20:50:010
32847499131,9cyclictest756295-21taskset00:35:233
32847499131,9cyclictest614796-21chrt22:50:103
32847499131,9cyclictest608571-21taskset22:45:143
32847499131,9cyclictest588179-21taskset22:25:223
32847499131,9cyclictest549465-21taskset21:55:493
32847499131,9cyclictest537240-21taskset21:50:093
32847499131,9cyclictest453264-21taskset20:45:073
32847499131,9cyclictest349652-21taskset19:20:373
328474991311,1cyclictest0-21swapper/322:55:103
328474991311,1cyclictest0-21swapper/321:42:283
328474991311,1cyclictest0-21swapper/320:21:303
328474991311,1cyclictest0-21swapper/319:59:543
328474991311,1cyclictest0-21swapper/319:50:533
32847499131,10cyclictest562518-21taskset22:08:243
32847499131,10cyclictest334940-21chrt19:14:443
328474991310,1cyclictest0-21swapper/321:18:583
328474991310,1cyclictest0-21swapper/320:53:323
328474991310,1cyclictest0-21swapper/320:40:143
328474991310,1cyclictest0-21swapper/320:10:203
32847499130,10cyclictest491274-21chrt21:11:313
32847499124,6cyclictest4789512sleep321:05:033
328474991211,0cyclictest0-21swapper/319:40:053
32847499120,9cyclictest648909-21taskset23:15:183
32847499120,9cyclictest634309-21chrt23:05:133
32847499120,9cyclictest414730-21taskset20:15:023
32847499120,8cyclictest653561-21taskset23:20:123
301798120,4rtkit-daemon667-21lldpd20:45:012
3887642110,4sleep1388913-21df_inode19:55:121
3669272110,8sleep2368200-21memory19:35:192
32847499111,8cyclictest363077-21taskset19:35:113
32847499110,8cyclictest504642-21chrt21:25:133
301798110,6rtkit-daemon746299-21grep00:30:150
6663862102,4sleep1666408-21apt-get23:30:121
6212222102,4sleep0621255-21apt-get22:55:130
5307442100,7sleep1530947-21smartctl21:45:141
301798100,6rtkit-daemon736994-21kworker/0:1+kacpid00:36:060
301798100,6rtkit-daemon388729-21/usr/sbin/munin19:55:132
301798100,6rtkit-daemon317-21systemd-udevd22:01:332
301798100,5rtkit-daemon691587-21/usr/sbin/munin23:45:230
301798100,5rtkit-daemon548953-21ntp_states21:55:212
301798100,3rtkit-daemon430-21avahi-daemon22:30:302
301798100,2rtkit-daemon0-21swapper/000:08:180
740000291,5sleep2742207-21tr00:25:182
719861290,6sleep0721955-21cut00:10:180
679202291,4sleep0679235-21apt-get23:40:130
609840290,6sleep2611469-21tr22:45:182
498256291,5sleep1498399-21df21:20:141
479904290,2sleep1480882-21kthreadcore21:05:161
442213290,6sleep0444293-21cut20:35:190
330410290,6sleep2332466-21tr19:10:192
30179890,5rtkit-daemon667-21lldpd23:02:060
30179890,5rtkit-daemon636-21snmpd20:32:242
30179890,5rtkit-daemon620278-21swap22:50:212
30179890,5rtkit-daemon453450-21df20:45:132
30179890,5rtkit-daemon335171-21munin-node21:12:212
30179890,5rtkit-daemon3205-21sendmail-mta19:50:160
30179890,5rtkit-daemon3200908-21packagekitd20:21:492
30179890,5rtkit-daemon2904-21cron21:49:542
30179890,4rtkit-daemon671301-21kthreadcore23:30:170
30179890,4rtkit-daemon601057-21chrt22:35:312
30179890,4rtkit-daemon571020-21sed22:15:172
30179890,4rtkit-daemon429181-21kthreadcore20:25:172
30179890,3rtkit-daemon335171-21munin-node20:03:482
750013281,4sleep2750025-21cron00:35:002
707220280,5sleep0709334-21kthreadcore00:00:200
698722280,4sleep1698755-21apt-get23:55:131
659997280,4sleep0660152-21diskstats23:25:150
652214281,4sleep1652354-21ntpq23:15:221
614539281,4sleep0614717-21sed22:50:010
600719281,5sleep1600939-21/usr/sbin/munin22:35:231
557476281,4sleep0558609-21kthreadcore22:05:180
549068281,4sleep0549179-21/usr/sbin/munin21:55:240
485392281,3sleep1485425-21apt-get21:10:141
467863280,5sleep00-21swapper/020:55:180
369742280,5sleep1369941-21cat19:40:151
350443281,4sleep0350575-21grep19:25:150
337868280,5sleep0338869-21kthreadcore19:15:180
327846282,3sleep30-21swapper/319:05:233
30179880,5rtkit-daemon667-21lldpd00:18:310
30179880,4rtkit-daemon638-21ntpd23:17:490
30179880,4rtkit-daemon638-21ntpd21:27:272
30179880,4rtkit-daemon636-21snmpd21:17:062
30179880,4rtkit-daemon636-21snmpd21:09:182
30179880,4rtkit-daemon636-21snmpd19:33:030
30179880,4rtkit-daemon523782-21runrttasks21:39:212
30179880,4rtkit-daemon492-21gmain19:54:422
30179880,4rtkit-daemon335171-21munin-node22:56:122
30179880,4rtkit-daemon335171-21munin-node22:26:582
30179880,4rtkit-daemon335171-21munin-node22:21:192
30179880,4rtkit-daemon335171-21munin-node20:10:552
30179880,4rtkit-daemon335171-21munin-node19:40:370
30179880,4rtkit-daemon335171-21munin-node00:22:150
30179880,4rtkit-daemon3200908-21packagekitd22:11:492
30179880,4rtkit-daemon295197-21munin-node19:12:210
30179880,4rtkit-daemon1567719-21kworker/0:2+kacpid19:35:070
30179880,1rtkit-daemon0-21swapper/221:52:002
30179880,1rtkit-daemon0-21swapper/220:56:402
30179880,1rtkit-daemon0-21swapper/220:08:382
755597272,2sleep2755768-21awk00:35:192
699999271,3sleep2701165-21grep23:55:172
672799271,2sleep10-21swapper/123:35:131
659959270,5sleep2659960-21/usr/sbin/munin23:25:132
659052271,4sleep1659292-21grep23:20:221
647987270,1sleep20-21swapper/223:15:182
594760271,4sleep1636-21snmpd22:32:031
511295270,4sleep1511421-21grep21:30:121
498400272,2sleep2498440-21cut21:20:162
462529270,5sleep1462830-21kthreadcore20:50:171
452327270,4sleep0452541-21grep20:40:230
427573271,3sleep0427606-21apt-get20:25:120
421185271,3sleep1421218-21apt-get20:20:131
400494270,3sleep0400551-21ntp_states20:00:200
388728271,3sleep0388761-21apt-get19:55:120
363164271,3sleep1363272-21/usr/sbin/munin19:35:141
355510270,4sleep2355567-21ntp_states19:25:212
347322270,5sleep2348956-21/usr/sbin/munin19:20:172
327511270,1sleep10-21swapper/119:05:201
322503271,3sleep20-21swapper/219:05:132
30179870,4rtkit-daemon638-21ntpd21:40:052
30179870,4rtkit-daemon335171-21munin-node20:15:272
30179870,3rtkit-daemon639373-21memory23:05:190
30179870,3rtkit-daemon638-21ntpd21:00:532
30179870,3rtkit-daemon638-21ntpd19:20:570
30179870,3rtkit-daemon636-21snmpd23:50:410
30179870,3rtkit-daemon636-21snmpd22:05:022
30179870,3rtkit-daemon492-21gmain19:47:530
30179870,3rtkit-daemon446256-21pool-udisksd20:36:252
30179870,3rtkit-daemon430-21avahi-daemon23:36:380
30179870,3rtkit-daemon335171-21munin-node23:20:060
30179870,3rtkit-daemon335171-21munin-node23:10:570
30179870,3rtkit-daemon335171-21munin-node22:40:062
30179870,3rtkit-daemon335171-21munin-node20:50:362
30179870,3rtkit-daemon2904-21cron19:06:000
30179870,3rtkit-daemon0-21swapper/000:25:080
717735260,1sleep20-21swapper/200:10:002
697815261,2sleep10-21swapper/123:50:241
642726260,3sleep1644837-21grep23:10:171
621258260,3sleep1621410-21df_inode22:55:151
613617260,3sleep1608383-21/usr/sbin/munin22:45:211
588863261,2sleep00-21swapper/022:30:140
576070260,3sleep1576216-21df22:20:131
568752260,1sleep00-21swapper/022:10:500
524112260,2sleep0524145-21apt-get21:40:140
510495261,3sleep1636-21snmpd21:26:521
498632262,2sleep01567719-21kworker/0:2-events21:20:170
472718260,4sleep0472790-21fschecks_time21:00:150
465533260,1sleep00-21swapper/020:51:050
447276260,3sleep1448213-21cut20:40:161
428623260,3sleep1429877-21kthreadcore20:25:171
407667260,1sleep00-21swapper/020:08:060
343850260,3sleep1344005-21diskstats19:20:111
337550260,4sleep2337746-21cut19:15:152
329511260,3sleep1330409-21cut19:10:181
738662250,2sleep1739999-21cut00:25:171
724361251,1sleep20-21swapper/200:15:132
723987250,1sleep10-21swapper/100:13:311
718391251,2sleep20-21swapper/200:10:152
691846250,1sleep20-21swapper/223:47:192
681962250,3sleep2684177-21kthreadcore23:40:192
680655251,2sleep1680694-21kthreadcore23:40:181
678655250,1sleep20-21swapper/223:36:352
672413250,1sleep20-21swapper/223:33:292
646793250,1sleep20-21swapper/223:14:512
634273250,2sleep20-21swapper/223:05:132
627884250,2sleep20-21swapper/223:00:132
601343250,1sleep00-21swapper/022:39:110
588353250,1sleep00-21swapper/022:26:480
575568250,1sleep00-21swapper/022:17:350
569595250,2sleep10-21swapper/122:15:121
558613251,2sleep10-21swapper/122:05:191
544058250,2sleep10-21swapper/121:55:161
543105250,1sleep00-21swapper/021:51:110
536546250,1sleep00-21swapper/021:47:420
523720250,1sleep10-21swapper/121:38:341
523671250,1sleep00-21swapper/021:37:560
511259251,2sleep00-21swapper/021:30:110
506971250,3sleep0509139-21cut21:25:190
492005250,3sleep0492204-21hddtemp_smartct21:15:170
491287250,1sleep00-21swapper/021:11:410
472531250,1sleep10-21swapper/121:00:121
454762251,2sleep10-21swapper/120:45:181
435445250,2sleep00-21swapper/020:30:180
426699250,1sleep00-21swapper/020:20:240
420587250,1sleep10-21swapper/120:16:011
420287250,3sleep0420531-21users20:15:240
414481250,1sleep10-21swapper/120:14:561
401637250,1sleep10-21swapper/120:05:071
395360250,3sleep1395391-21awk20:00:141
358710251,2sleep20-21swapper/219:30:172
356104250,1sleep10-21swapper/119:26:091
730799240,1sleep20-21swapper/200:20:142
730380240,3sleep10-21swapper/100:18:131
710993240,3sleep20-21swapper/200:00:462
692315240,1sleep20-21swapper/223:50:132
665960240,3sleep10-21swapper/123:28:001
653525240,2sleep20-21swapper/223:20:112
640141240,3sleep10-21swapper/123:06:361
620757240,1sleep00-21swapper/022:52:200
614988240,1sleep10-21swapper/122:50:131
607969240,3sleep00-21swapper/022:42:590
601948240,1sleep10-21swapper/122:40:111
585166240,2sleep10-21swapper/122:25:171
576034240,2sleep00-21swapper/022:20:120
556025240,3sleep00-21swapper/022:02:240
551528240,2sleep1552997-21kthreadcore22:00:171
525566240,1sleep10-21swapper/121:40:191
484889240,3sleep00-21swapper/021:06:550
409814240,2sleep0411688-21kthreadcore20:10:180
384809240,1sleep10-21swapper/119:50:211
377402240,2sleep20-21swapper/219:45:162
375948240,1sleep10-21swapper/119:45:111
369514240,1sleep20-21swapper/219:40:112
338871240,2sleep10-21swapper/119:15:181
753691230,1sleep1755596-21/usr/sbin/munin00:35:191
743868230,1sleep10-21swapper/100:30:101
730791230,1sleep10-21swapper/100:20:091
711618230,1sleep10-21swapper/100:05:141
705374230,1sleep10-21swapper/100:00:171
686077230,1sleep10-21swapper/123:45:141
633692230,1sleep10-21swapper/123:00:521
562938230,1sleep10-21swapper/122:10:151
542305230,1sleep10-21swapper/121:50:201
491805230,1sleep10-21swapper/121:15:131
466290230,1sleep10-21swapper/120:55:151
446226230,1sleep10-21swapper/120:35:471
434177230,1sleep10-21swapper/120:30:151
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional